Amazon Managed Service for Apache Flink

Amazon Managed Service for Apache Flink can be used for real-time analysis of streaming data. Launched in 2016, it’s the AWS-managed version of the open-source Apache Flink processing framework.

It allows querying and analysis of streaming data coming from sources such as Amazon Kinesis Data Streams, Amazon MSK (Managed Streaming for Apache Kafka), or Amazon S3. The output of Managed Service for Apache Flink can be sent to other AWS services (or other tools) for further analysis or data responses.

Note: Prior to September 2023, this service was known as Amazon Kinesis Data Analytics.

Amazon Managed Service for Apache Flink Studio

In this section, we describe a recommended way to get started with Amazon Managed Service for Apache Flink. Our example uses a Kinesis data stream, a Studio notebook, and more.

Creating a new Kinesis data stream

A Kinesis data stream is a way for us to accept large amounts of real-time data for further analysis.

Navigate to the "Kinesis" area of the AWS Console, click “Data streams” on the left side menu, and then click the “Create data stream” button.