Research on how Kubernetes is used in Industries and what all use cases are solved by Kubernetes?
ARTH — Task 16 👨🏻💻
Why use Kubernetes?
Kubernetes allows you to deploy cloud-native applications anywhere and manage them exactly as you like everywhere. Containers package up the services comprising an application and make them portable across different compute environments, for both dev/test and production use.
CODE ONCE, RUN ANY-TIME, ANY WHERE.
What is Kubernetes?
Kubernetes is a portable, extensible, open-source platform for managing containerized workloads and services, that facilitates both declarative configuration and automation. It has a large, rapidly growing ecosystem. Kubernetes services, support, and tools are widely available.
How is Kubernetes benefits you using it?
You can use Docker containers as a core building block creating modern applications and platforms. Docker makes it easy to build and run distributed microservices architecture, deploy your code with standardized continuous integration and delivery pipelines, build highly-scalable data processing systems, and create fully-managed platforms for your developers.
Transformation of the Container Technology to next Kubernetes:
More over the simplicity of docker launching has completes been automated by focusing on horizantal scaling rather than vertical scaling.
What are containers and where does Kubernetes fit in?
In order to better understand the kubernetes the grand father must be known better i.e DOCKER, to bring the kubernetes into the World.
What is Docker ??
Docker is a Container technology used built to replace the possibility of making the Operating system booting time as low as possible and the reality to this Docker i.e Container Technology
Containers isolate software from its surroundings and we use the container images to operate instead of regular OS images via .gz, .torrent, amd64 etc.
What is Container image ??
A container image is a lightweight, stand-alone, executable package of a piece of software that includes everything needed to run it: code, runtime, system tools, system libraries, settings.
Deploying a container is relatively simple, shortly after Dockers’ release, lots of software-companies started using the technology in their software development and test process. But when it comes to actually running containers in production, you can end up with dozens — or even millions when using micro-services — of containers over time.
Where comes Docker Problem ??
Container orchestration (a.k.a. container management) i.e. Kubernetes comes to the rescue.
Kubernete’s *Use-Cases*:
Problem 1 : Processing Petabytes of Data More Efficiently with Kubernetes
SOLUTION- 1: [faced by CERN Company]
Location: Geneva, Switzerland
Field it is working on: Industry Particle physics research
Cause:
At CERN, the European Organization for Nuclear Research, physicists conduct experiments to learn about fundamental science. In its particle accelerators, “we accelerate protons to very high energy, close to the speed of light, and we make the two beams of protons collide,” says CERN Software Engineer Ricardo Rocha. “The end result is a lot of data that we have to process.” CERN currently stores 330 petabytes of data in its data centers, and an upgrade of its accelerators expected in the next few years will drive that number up by 10x. Additionally, the organization experiences extreme peaks in its workloads during periods prior to big conferences, and needs its infrastructure to scale to those peaks.
When the data exceeds then it is better to have a more hybrid infrastructure, where we have our on premise infrastructure but can make use of public clouds temporarily when these peaks come up, in data handling.
For detailed picture of the Data-produced can be viewed in my Blog here.
Solution ->>
CERN’s technology team embraced containerization and cloud native practices, choosing Kubernetes for orchestration:
- Helm for deployment,
- Prometheus for monitoring, and
- CoreDNS for DNS resolution inside the clusters.
Kubernetes federation has allowed the organization to run some production workloads both on premise and in public clouds.
The time to deploy a new cluster for a complex distributed storage system has gone from more than 3 hours to less than 15 minutes. Adding new nodes to a cluster used to take more than an hour; now it takes less than 2 minutes ……..SO COOL😎😎
A solution to host virtual machines is expected to also get 10% of memory capacity back provided by kubernetes. With such results, adoption of Kubernetes has made rapid gains at CERN, and the team is eager to give back to the community. “If we look back into the ’90s and early 2000s, there were not a lot of companies focusing on systems that have to scale to this kind of size, storing petabytes of data, analyzing petabytes of data,” says Rocha. “The fact that Kubernetes is supported by such a wide community and different backgrounds, it motivates us to contribute back.”
SOLUTION- 2: [faced by Spotify Company]
Problem having: On Demand of Music increased the customers from both (Listening and Music Creators too) which caused to change their home infrastructure into much more reliable management.
Cause:
It was launched in 2008, the audio-streaming platform has grown to over 200 million monthly active users across the world. “Our goal is to empower creators and enable a really immersive listening experience for all of the consumers that we have today.
we know that 👇👇
Hopefully by the consumers we’ll have in the future.
Tactic of every business today. So they opted previous Helios
What is Helios??
Helios project was created when there were no open source container orchestration frameworks. Since the advent of Kubernetes and other tools, we’ve stopped adding new features to Helios and are now switching to other tools like Kubernetes. This project will no longer have new features or accept PRs for new features. We will continue to accept bug fixes, however.
Helios is a Docker orchestration platform for deploying and managing containers across an entire fleet of servers. Helios provides a HTTP API as well as a command-line client to interact with servers running your containers. It also keeps a history of events in your cluster including information such as deploys, restarts and version changes.
As the Helios Project got under no future bug-fixes and other high-lighted points mentioned above there started the chance of privacy and risk so the gradually attention of Spotify shifted towards the other Companies that offer the Orchestration which helped the Spotify to get into the Hands of Kubernetes as its main orchestration tool.
Solution ===>>
Kubernetes fit very nicely as a complement and now as a replacement to Helios.
The migration, which would happen in parallel with Helios running, could go smoothly as kubernetes is best-fit.
Kubernetes was more feature-rich than Helios. Plus, “Spotify wanted to benefit from added velocity and reduced cost, and also align with the rest of the industry on best practices and tools.”
“A small percentage of our fleet has been migrated to Kubernetes, and some of the things that we’ve heard from our internal teams are that they have less of a need to focus on manual capacity provisioning and more time to focus on delivering features for Spotify,” says Chakrabarti.
One success story that’s come out of the early days of Kubernetes is a tool called Slingshot that a Spotify team built on Kubernetes. “With a pull request, it creates a temporary staging environment that self destructs after 24 hours.
======================================
Tools made in collabaration with Kubernetes and Spotify:
Spotify has also started to use gRPC and Envoy, replacing existing homegrown solutions, just as it had with Kubernetes
Along with this “Before, teams would have to wait for an hour to create a new service and get an operational host to run it in production, but with Kubernetes, they can do that on the order of seconds and minutes.” In addition, with Kubernetes’s bin-packing and multi-tenancy capabilities, CPU utilization has improved on average two- to threefold.
>> which leads to better management and monitoring of the entire setup while focusing on CORE≤=≥Features
THANK YOU 😊😊
Finally we are done with use-cases, so a treat for you !!!!
