Containers
Category: AWS Fargate
Announcing additional Linux controls for Amazon ECS tasks on AWS Fargate
Introduction An Amazon Elastic Container Service (Amazon ECS) task is a number of co-located containers that are scheduled on to AWS Fargate or an Amazon EC2 container instance. Containers use Linux namespaces to provide workload isolation—and with namespaces—even though containers are scheduled together in an Amazon ECS task, they’re still isolated from each other and […]
AWS Fargate adds support for larger ephemeral volumes
Introduction AWS Fargate is a serverless, pay-as-you-go compute engine that allows you focus on building applications without having to manage servers. Starting today, the amount of ephemeral storage you can allocate to the containers in a EKS Fargate pod is configurable up to a maximum of 175 GiB per pod. Prior to this launch, all […]
Shift left to secure your container supply chain
Introduction When we talk about securing container solutions, most of the focus is on securing the orchestrator or the infrastructure that the orchestrator runs on. However, at the heart of your container solutions are the containers themselves. In this post, we show you how we ensured that before we even push a container into our […]
Under the hood: Lazy Loading Container Images with Seekable OCI and AWS Fargate
November 2023: AWS Fargate now supports having both SOCI and non SOCI enabled containers in the same Amazon ECS task, therefore the “All container images within an Amazon ECS Task need a SOCI Index Manifest” restriction no longer applies. To learn more see the whats new post. AWS Fargate, a serverless compute engine for […]
Scaling IaC and CI/CD pipelines with Terraform, GitHub Actions, and AWS Proton
Introduction Modern applications run on a variety of compute platforms in AWS including serverless services such as AWS Lambda, AWS App Runner, and AWS Fargate. Organizations today are often required to support architectures using a variety of these AWS services, each offering unique runtime characteristics, such as concurrency and scaling, which can be purpose fit […]
Hosting Amazon Managed Workflows for Apache Airflow (MWAA) Local-runner on Amazon ECS Fargate for development and testing
Introduction Data scientists and engineers have made Apache Airflow a leading open-source tool to create data pipelines due to its active open-source community, familiar Python development as Directed Acyclic Graph (DAG) workflows, and an extensive library of pre-built integrations. Amazon Managed Workflows for Apache Airflow (MWAA) is a managed service for Apache Airflow that makes […]
Migrate cron jobs to event-driven architectures using Amazon Elastic Container Service and Amazon EventBridge
Introduction Many customers use traditional cron job schedulers in on-premise systems. They need a simple approach to move these scheduled tasks to AWS without refactoring while unlocking the scalability of the cloud. A lift-and-shift migration to Amazon Elastic Compute Cloud (Amazon EC2) is always a possibility, but that doesn’t take advantage of cloud-native services or […]
How Sentra manages data workflows using Amazon EKS, Dagster, and Karpenter to maximize cost-efficiency with minimal operational overhead
By Yael Grossman Sr Compute Specialist Solutions Architect at AWS, Roei Jacobovich Software Engineer at Sentra Introduction In this post, we’ll illustrate how Sentra utilizes Amazon Elastic Kubernetes Service (Amazon EKS), AWS Fargate , EC2 Spot, Karpenter, and an open-source version of Dagster, a cloud-native orchestrator, to run efficient and scalable data processing workloads on […]
Implementing a pub/sub architecture with AWS Copilot
Introduction The AWS Copilot CLI is a tool that since its launch in 2020, developers have been using to build, manage, and operate Linux and Windows containers on Amazon Elastic Container Service (Amazon ECS), AWS Fargate, and AWS App Runner. In this post, I’ll walk you through how you can use AWS Copilot CLI to […]
Architecture evolution: From zero to future-proof architecture at home24
This blog was co-authored by Aurelijus Banelis, Senior Software Engineer at home24 Introduction Home24 is a leading pure-play home & living e-commerce platform in continental Europe and Brazil. It has third-party and private-label assortments combined with a tailored user experience — and that is a good foundation for a sustainable technology business. Aurelijus is proud […]