AWS Open Source Blog
Category: Open Source
AWS Investing an Additional $10 Million in Open Source Supply Chain Security
Security is our top priority at AWS. As a result, we are committed to contributing to the quality and safety of open source software. We see great value in contributing both engineering efforts and also projects, tools, training, and guidelines to help improve the security of open source software. These efforts benefit us, our customers, […]
Ogury Uses Open Source Technologies on AWS to Run Low-Latency Machine Learning
This post was contributed by Thomas Ngue Minkeng, Nathalie Au, Marc Bouffard, and Pierre-Marie Airiau from Ogury Ogury, the Personified Advertising company, is using open source machine learning (ML) on AWS to deliver a planned 300,000 inferences per second under 10-ms latency. Ogury’s breakthrough advertising engine delivers precision, sustainability, and privacy protection within one technology […]
Compliance auditing with Steampipe and SQL
This post was contributed by David Boeke, Bob Tordella, Jon Udell, and Nathan Wallace. Steampipe is an open source tool under the AGPLv3 license for querying cloud APIs in a universal way and reasoning about the data in SQL. In our first post we explored the AWS plugin which maps the suite of AWS APIs […]
Announcing Amazon CloudWatch for Ray
Amazon CloudWatch is now available for Ray on Amazon Elastic Compute Cloud (Amazon EC2). Ray is an open source (Apache 2.0 License) framework to build and scale distributed applications. CloudWatch is a monitoring and observability service that provides data and actionable insights to monitor your applications, respond to system-wide performance changes, and optimize resource utilization. […]
Easily Running Open Policy Agent Serverless with AWS Lambda and Amazon API Gateway
Open Policy Agent (OPA) is an open source general-purpose policy engine, licensed under the Apache License 2.0, that allows you to decouple policy decision-making from application code. OPA assists organizations in effectively implementing policy as code. It allows policy to be expressed through a high-level declarative language (Rego), and it also allows policy authoring to […]
Scheduling Jupyter Notebooks with AWS Orbit Workbench
This post was contributed by Olalekan Elesin, Head of Data Platform & Data Architect at HRS Group and AWS Machine Learning Hero The HRS Group, a market leader in the global business travel market, is scheduling Jupyter Notebooks with the open source solution AWS Orbit Workbench. HRS provides brokerage of hotel rooms for private and […]
Simplify development using AWS Lambda container image with a Serverless Framework
Container image support for AWS Lambda lets developers package function code and dependencies using familiar patterns and tools. With this pattern, developers use standard tools like Docker to package their functions as container images and deploy them to Lambda. In this post, we demonstrate how to use open source tools and AWS continuous integration and […]
Enabling Amazon Simple Storage Service (Amazon S3) Access Points in Apache Hadoop S3A
We’re pleased to announce that Amazon Simple Storage Service (Amazon S3) Access Points can now be used in Apache Hadoop 3.3.2 and any framework consuming the S3A connector or relying on the Hadoop Distributed File System (such as Apache Spark, Apache Hive, Apache Pig, and Apache Flink). In this post, we review what access point […]
Managing Spinnaker using Spinnaker Operator in Amazon EKS
Overview Spinnaker enables developers to focus on writing code and deploying their applications without having to worry about the underlying infrastructure. The development team can focus on application development and leave ops provisioning to Spinnaker for automating reinforcement of business and regulatory requirements. Spinnaker, a cloud-based open source continuous delivery platform built originally by Netflix […]
Building a multi-tenant Kubeflow environment on Amazon EKS using Amazon Cognito and ADFS
NOTE: Since this blog post was written, much about Kubeflow has changed. While we are leaving it up for historical reference, more accurate information about Kubeflow on AWS can be found here. The Kubeflow project is dedicated to making deployments of machine learning (ML) workflows on Kubernetes simple, portable, and scalable. The project’s goal is […]