Kafka Topic as a Log
Explore how Kafka topics act like immutable, ordered logs with line-numbered offsets that ensure message order and consumer continuity. Understand the role of partitions in scaling topics across disks for distributed storage.
We'll cover the following...
We'll cover the following...
We have already encountered the term topic, albeit not formally. We know that a topic is a channel with a name to which we can produce messages and from which we can consume messages. But how is data actually stored in a topic? Before we answer this question, let’s talk about logs.
Logs
Think about a log file produced by an application—each line:
Has a line number or an index.
Can not be changed after it ...