AWS Open Source Blog

Amazon's Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2

Amazon’s Exabyte-Scale Migration from Apache Spark to Ray on Amazon EC2

Large-scale, distributed compute framework migrations are not for the faint of heart. There are backwards-compatibility constraints to maintain, performance expectations to meet, scalability limits to overcome, and the omnipresent risk of introducing breaking changes to production. This all becomes especially troubling if you happen to be migrating away from something that successfully processes exabytes of […]

Getting Started with Cilium Service Mesh on Amazon EKS

Getting Started with Cilium Service Mesh on Amazon EKS

Cilium is an open source solution for providing, securing, and observing network connectivity between workloads, powered by the revolutionary kernel technology called extended Berkeley Packet Filter (eBPF). eBPF enables the dynamic insertion of security, visibility, and networking logic into the Linux kernel. Cilium provides high-performance networking, advanced load balancing, transparent encryption, and observability. Cilium was […]