- PubSub
Introduction to PubSub and its producer and consumer APIs.
We'll cover the following...
What is PubSub?
PubSub is a fully-managed streaming platform available on GCP. It provides similar functionality to Kafka for achieving high throughput and low latency when handling large volumes of messages. However, it reduces the amount of DevOps work needed to maintain the pipeline. One of the benefits of PubSub is that the APIs map well to common use cases for streaming Dataflow pipelines.
Setting up PubSub
Unlike Kafka, PubSub uses separate concepts for producer and consumer data sources. In Kafka, you can publish and subscribe to a topic directly, while in PubSub consumers subscribe to subscriptions rather than directly subscribing to topics. With PubSub, you first set up a topic and then create one or more subscriptions that listen to this topic.
Creating a topic
To create a ...