AWS Open Source Blog
Category: Open Source
AWS Cloud Map service discovery for serverless applications
Microservices-based architecture helps reduce the complexity of application components, while posing a new class of problems related to the connectivity between microservices. Keeping track of all your application components, whether custom-built or managed AWS services, across multiple stages and deployments is a challenging task. AWS Cloud Map is a fully-managed service discovery tool for all […]
Amazon joins the Java Community Process (JCP)
Amazon runs thousands of Java production services; both we and our customers depend heavily on various distributions of the JDK (Java Development Kit). In 2016 we started building Amazon Corretto, our OpenJDK binary distribution, and started using it to run AWS and other Amazon services. In 2018, we open sourced Corretto and made it available […]
How AWS is helping to open source the future of robotics
Our robot overlords may not take over anytime soon, but when they do, they’ll likely be running ROS. ROS, or Robot Operating System, was launched over a decade ago to unite developers in building “a collection of tools, libraries, and conventions that aim to simplify the task of creating complex and robust robot behavior across […]
Deploying Spark jobs on Amazon EKS
UPDATE, March 2021: This blog post describes how to deploy self-managed Apache Spark jobs on Amazon EKS. AWS now provides a fully managed service with Amazon EMR on Amazon EKS. This new deployment option allows customers to automate the provisioning and management of Spark on Amazon EKS, and benefit from advanced features such as Amazon […]
AWS’ sponsorship of the Rust project
We’re really excited to announce that AWS is sponsoring the Rust programming language! Rust is designed for writing and maintaining fast, reliable, and efficient code. It has seen considerable uptake since its first stable release four years ago, with companies like Google, Microsoft, and Mozilla all using Rust. Rust has also seen lots of growth […]
AWS promotional credits for open source projects
AWS has always aimed to help make technology that was historically cost-prohibitive and difficult for many organizations to adopt much more accessible to a broader audience. This applies to open source technologies as well. We help customers to run a wide variety of open source operating systems on EC2. We offer managed services for open […]
How AWS built a production service using serverless technologies
Our customers are constantly seeking ways to increase agility and innovation in their organizations, and often reach out to us wanting to learn more about how we iterate quickly on behalf of our customers. As part of our unique culture (which Jeff Barr discusses at length in this keynote talk), we constantly explore ways to […]
Distributed TensorFlow training using Kubeflow on Amazon EKS
Training heavy-weight deep neural networks (DNNs) on large datasets ranging from tens to hundreds of GBs often takes an unacceptably long time. Business imperatives force us to search for solutions that can reduce the training time from days to hours. Distributed data-parallel training of DNNs using multiple GPUs on multiple machines is often the right […]
Join us for the Open Distro Hack Day and more at All Things Open in Raleigh, NC
Note: See the All Things Open 2018 – Conference Wrap-Up for links to slides and more! We’re excited to return to one of our favorite open source community conferences, All Things Open, taking place October 13-15 in Raleigh, NC. AWS is a Presenting Sponsor, and we have some great events lined up – please join […]
Running secure workloads on EKS using Fairwinds Polaris
Getting configurations right, especially at scale, can be a challenging task in cloud-native land. Automation helps you to make that task more manageable. In this guest post from EJ Etherington, CTO for Fairwinds, we look at an open source tool that allows you to check your EKS cluster setup, providing you with a graphical overview […]