High-level Design of Kafka
Learn about the basic building blocks and programming interface of Kafka.
We'll cover the following
Data flow
Let's start with the basic units of Kafka and build up the concepts of the components in which they are saved.
Message
The basic unit of data in Kafka is called a message. It can be thought of as a row in a CSV file or a record in a database. Messages contain a payload of bytes. It can also have a payload of metadata, referred to as a key. Keys can be hashed to write messages to certain partitions in a
Batch
Messages are exported to Kafka in batches to increase its throughput. A batch is a set of messages that exist in the same partition of a topic.
Level up your interview prep. Join Educative to access 80+ hands-on prep courses.