Kafka Topic Partitions
Understand what Kafka topic partitions are, why are they needed, and how they work.
We'll cover the following...
A topic can be broken down into multiple partitions. Each partition is a log on its own and has its own set of offsets. When messages are produced to a topic, each message can be routed to a different partition. Let’s take a look at a topic with three partitions:
Press + to interact
Each partition has its own set of offsets
There are two main reasons to have multiple partitions in a topic. We learned about the first reason in the previous section—partitioning the topic enables horizontal scaling for the topic’s size. Kafka can keep each partition on a different machine with its own disk, allowing topics to grow beyond the ...