AWS Open Source Blog
Category: Amazon Elastic Kubernetes Service
etcd gets ready to graduate
Update: On November 24, 2020 the Cloud Native Computing Foundation announced etcd graduation. Etcd, a distributed key-value store that helps powers projects such as Kubernetes, is set to join the ranks of the most critical and recognizable projects for open source computing. The Cloud Native Computing Foundation (CNCF), the non-profit foundation that serves as the […]
Virtual GPU device plugin for inference workloads in Kubernetes
Machine learning (ML) has become a centerpiece for enterprise transformation. AWS provides a broad and deep set of ML capabilities for builders with all levels of expertise. Developers with no prior ML experience can seamlessly build sophisticated AI-driven applications using AWS AI services. Developers and data scientists can use Amazon SageMaker, a managed machine learning […]
Using the K3s Kubernetes distribution in an Amazon EKS CI/CD pipeline
Modern microservices application stack, CI/CD pipeline, Kubernetes as orchestrator, hundreds or thousands of deployments per day—this all sounds good, until you realize that your Kubernetes development or staging environments are messed up by these deployments, and changes done by one developer team are affecting your developer team’s Kubernetes environment. In this post, we will walk […]
Improving HA and long-term storage for Prometheus using Thanos on EKS with S3
Prometheus is an open source systems monitoring and alerting toolkit that is widely adopted as a standard monitoring tool with self-managed and provider-managed Kubernetes. Prometheus provides many useful features, such as dynamic service discovery, powerful queries, and seamless alert notification integration. Beyond certain scale, however, problems arise when basic Prometheus capabilities do not meet requirements […]
Dgraph on AWS: Setting up a horizontally scalable graph database
This article is a guest post from Joaquin Menchaca, an SRE at Dgraph. Dgraph is an open source, distributed graph database, built for production environments, and written entirely in Go. Dgraph is fast, transactional, sharded, and distributed (joins, filters, sorts), consistently replicated with Raft, and provides fault tolerance with synchronous replication and horizontal scalability. The […]
Running TorchServe on Amazon Elastic Kubernetes Service
This article was contributed by Josiah Davis, Charles Frenzel, and Chen Wu. TorchServe is a model serving library that makes it easy to deploy and manage PyTorch models at scale in production environments. TorchServe removes the heavy lifting of deploying and serving PyTorch models with Kubernetes. TorchServe is built and maintained by AWS in collaboration […]
Enterprise-ready Kubeflow: Securing and scaling AI and machine learning pipelines with AWS
NOTE: Since this blog post was written, much about Kubeflow has changed. While we are leaving it up for historical reference, more accurate information about Kubeflow on AWS can be found here. Many AWS customers are building AI and machine learning pipelines on top of Amazon Elastic Kubernetes Service (Amazon EKS) using Kubeflow across many […]
Why Jenkins still continuously serves developers
For an estimated 15 million developers, Jenkins is synonymous with countless iterations of collectible stickers of the iconic, non-assuming butler that have adorned their laptops all over the world. The butler is representative of the ubiquitous open source continuous integration (CI) technology that has quietly automated an endless set of development tasks for well over […]
Monitor AWS services used by Kubernetes with Prometheus and PromCat
AWS offers Amazon CloudWatch to provide observability of the operational health for your AWS resources and applications through logs, metrics, and events. CloudWatch is a great way to monitor and visualize AWS resources metrics and logs. Recently I’ve found that some customers are adopting Prometheus as their monitoring standard because it offers the ability to […]
Managing secrets deployment in Kubernetes using Sealed Secrets
Kubernetes is an open source system for automating the deployment, scaling, and management of containerized applications. It is especially suitable for building and deploying cloud-native applications on a massive scale, leveraging the elasticity of the cloud. Amazon Elastic Kubernetes Service (Amazon EKS) is a managed service for running a production-grade, highly available Kubernetes cluster on […]