Containers

Tag: EKS

webhook architecture diagram

Building serverless admission webhooks for Kubernetes with AWS SAM

Authors: Simon Woldemichael, Associate Solutions Architect, WWPS Solution Architecture Josh Jiang, Associate Cloud Developer, Professional Services Shared Delivery Teams Learning Level: 300 Controlling resource deployments in your Kubernetes cluster can become a difficult challenge. For instance, pushing changes to a production environment can run the risk of installing an incompatible package or vulnerable dependency that […]

Improved Amazon EKS console for cluster creation and management

We recently announced an updated Amazon EKS console experience to create clusters, management, and supporting documentation. In this blog post, we dive into the updates we have made and how they aim to help our customers and cluster administrators when creating clusters using the Amazon EKS console. 1. Multi-step cluster create flow EKS now includes […]

Fault tolerant distributed machine learning training with the TorchElastic Controller for Kubernetes

Introduction Kubernetes enables machine learning teams to run training jobs distributed across fleets of powerful GPU instances like Amazon EC2 P3, reducing training time from days to hours. However, distributed training comes with limitations compared to the more traditional microservice based applications typically associated with Kubernetes. Distributed training jobs are not fault tolerant, and a […]

Optimizing Spark performance on Kubernetes

Apache Spark is an open source project that has achieved wide popularity in the analytical space. It is used by well-known big data and machine learning workloads such as streaming, processing wide array of datasets, and ETL, to name a few. Kubernetes is a popular open source container management system that provides basic mechanisms for […]

Under the hood: AWS Fargate data plane

Today, we launched a new platform version (1.4) for AWS Fargate, which bundles a number of new features and capabilities for our customers. You can read more about these features in this blog post. One of the changes we are introducing in platform version 1.4 is replacing Docker Engine with Containerd as Fargate’s container execution […]

AWS Fargate platform versions primer

AWS Fargate is a managed service to run containers. This is an AWS managed service that allows users to launch containers without having to worry about the infrastructure underneath. In another blog post, we explored in detail the new features and the changes we introduced with AWS Fargate platform version 1.4.0. Let’s step back and […]

AWS Fargate launches platform version 1.4.0

AWS Fargate is a managed service to run containers. Fargate allows customers to use Amazon Elastic Container Service (ECS) and Amazon Elastic Kubernetes Service (EKS) to launch applications without the burden of having to deal with the undifferentiated heavy lifting of maintaining, patching, scaling, securing, life-cycling the infrastructure. While Amazon EC2 abstracts away hypervisors and […]

Multi-tenant design considerations for Amazon EKS clusters

This post was contributed by Roberto Migli, AWS Solutions Architect.  Amazon Elastic Kubernetes Service (Amazon EKS) is used today by thousands of customers to run container applications at scale. One of the common questions that often we hear is: how do we provide a multi-tenant Amazon EKS cluster to our teams? Should I run one cluster, […]

Upcoming Changes to IP Assignment for EKS Managed Node Groups

When using Amazon EKS, all nodes need the ability to connect to the EKS-hosted Kubernetes cluster and to other AWS APIs such as Amazon Elastic Container Registry (ECR) or Amazon S3. Nodes can run in private or public subnets. For private subnets, this traffic typically routes through an AWS PrivateLink connection to reach endpoints within […]

Enabling cross-account access to Amazon EKS cluster resources

Amazon Elastic Kubernetes Service (Amazon EKS) is a managed service that makes it easy for you to run Kubernetes on AWS without needing to stand up or maintain your own Kubernetes control plane. The recent launches of managed node groups and Amazon EKS on AWS Fargate removes the need to provision and manage infrastructure for pods. Kubernetes […]