Learn about Apache Kafka's architecture, client APIs, stream processing, and connectors. Build real-time data streaming and event-driven applications while exploring Kafka's ecosystem.

build.tar.gz

producer-sync-example

producer-async-example

part1-dsl-api-stateful-ops

part2-dsl-api-stateful-ops

part3-dsl-api-stateful-ops

interactive-queries

testing-kafka-streams

spring-kafka

spring-kafka-consumer

consumer-api-example

queue-topic-example

consumer-api-config-example

kafka-connect-transformations-example

kafka-connect-sink-example

kafka-connect-source-example

kafka-schema-registry-example

Apache Kafka is a distributed streaming platform designed to handle real-time data streaming and processing in a distributed and fault-tolerant manner. This course can be taken by software developers and data engineers wanting to learn Kafka to build data-intensive applications. 

You will begin with an introduction to the Kafka architecture, client libraries, and its project ecosystem. Next, you will learn to use the Kafka Client APIs along with key configurations. Then, you will learn to develop stream processing applications using Kafka Streams. You will also explore the Kafka Connect Source and Sink connectors. You will finish by learning to make Kafka-related projects in addition to the core ecosystem. 

After completing this course, you will be comfortable with developing data-intensive applications. The course will prove helpful for anyone who wants to learn Kafka using a practical, hands-on approach for building real-time data streaming, event-driven architecture, microservices, and log aggregation.

Mastering Apache Kafka

**(True or False)** Each consumer instance inside a consumer group receives all events from a topic partition.

(True or False) Each consumer instance inside a consumer group receives all events from a topic partition.

Subscribe to topic(s), commit offset(s), poll, and close

Subscribe to topic(s), poll, process, and commit offset(s)

Subscribe to topic(s), process, commit offset(s), and poll

What's the correct order of actions that a Kafka consumer executes?

What’s the correct order of actions that a Kafka consumer executes?

By setting the `mode` configuration property in the Consumer API to `queue` or `topic`

By having multiple Kafka brokers in a cluster

By setting the `topic` configuration property in the Consumer API to `true` or `false`

How can Kafka be used as a queue and a pub/sub (topic) based system?

How can Kafka be used as a queue and a pub/sub (topic) based system?

Which Consumer API configuration should be set to `latest` if you only want to consume new messages after the consumer starts?

Which Consumer API configuration should be set to <code>latest</code> if you only want to consume new messages after the consumer starts?

**(True or False)** Consumers with the same `group.id` configuration belong to the same consumer group.

(True or False) Consumers with the same <code>group.id</code> configuration belong to the same consumer group.

Test your understanding of  the Kafka Consumer API.


Quiz: Kafka Consumer API

Test your understanding of  the Kafka Consumer API.

Introduction

Apache Kafka Producer API

Apache Kafka Consumer API

Setting up a Streaming Data Pipeline With Kafka

Kafka Streams

Kafka Connect

Exploring Projects in the Kafka Ecosystem

Wrap Up

Final Project

Quiz: Kafka Consumer API