Introduction to Queue-Based Distribution

As described, for example, in the lesson on Asynchronous HTTP API, it is not always possible or the best approach to synchronously reply to a client request. Sometimes, the best response is to accept a job and promise to execute it later.

Implementing a distributed system using queues is a trade-off, improving throughput with the drawback of increased latency.

Queue-based architecture

Looking at basic architecture, it is composed of two elements: a queue that stores jobs and workers that consume the jobs from a queue, process them and send the result to another destination.