AWS News Blog

Category: Amazon Managed Streaming for Apache Kafka (Amazon MSK)

Architecture diagram.

New for Amazon Redshift – General Availability of Streaming Ingestion for Kinesis Data Streams and Managed Streaming for Apache Kafka

Ten years ago, just a few months after I joined AWS, Amazon Redshift was launched. Over the years, many features have been added to improve performance and make it easier to use. Amazon Redshift now allows you to analyze structured and semi-structured data across data warehouses, operational databases, and data lakes. More recently, Amazon Redshift […]

AWS Week in Review – August 22, 2022

This post is part of our Week in Review series. Check back each week for a quick roundup of interesting news and announcements from AWS! I’m back from my summer holidays and ready to get up to date with the latest AWS news from last week! Last Week’s Launches Here are some launches that got […]

AWS Week in Review – May 2, 2022

This post is part of our Week in Review series. Check back each week for a quick roundup of interesting news and announcements from AWS! Wow, May already! Here in the Pacific Northwest, spring is in full bloom and nature has emerged completely from her winter slumbers. It feels that way here at AWS, too, […]

Amazon MSK Serverless Now Generally Available–No More Capacity Planning for Your Managed Kafka Clusters

Today we are making Amazon MSK Serverless generally available to help you reduce even more the operational overhead of managing an Apache Kafka cluster by offloading the capacity planning and scaling to AWS. In May 2019, we launched Amazon Managed Streaming for Apache Kafka (Amazon MSK) to help our customers stream data using Apache Kafka. […]

Amazon MSK Connect logo

Introducing Amazon MSK Connect – Stream Data to and from Your Apache Kafka Clusters Using Managed Connectors

March 14, 2023: There is now an example of how to use the Debezium MySQL connector plugin with a MySQL-compatible Amazon Aurora database as the source in the MSK documentation. November 10, 2022: Post updated to include some clarifications on how to better set up Debezium using MSK Connect. Apache Kafka is an open-source platform […]

Architectural diagram.

Introducing Amazon Kinesis Data Analytics Studio – Quickly Interact with Streaming Data Using SQL, Python, or Scala

The best way to get timely insights and react quickly to new information you receive from your business and your applications is to analyze streaming data. This is data that must usually be processed sequentially and incrementally on a record-by-record basis or over sliding time windows, and can be used for a variety of analytics […]

New – Serverless Streaming ETL with AWS Glue

When you have applications in production, you want to understand what is happening, and how the applications are being used. To analyze data, a first approach is a batch processing model: a set of data is collected over a period of time, then run through analytics tools. To be able to react quickly, you can […]