System Design: The Distributed Task Scheduler
Define the core function of a task scheduler in allocating resources for background tasks. Discover why large distributed systems require a dedicated, scalable scheduler to manage billions of tasks from multiple sources.
What is a task scheduler?
A task is a unit of computational work requiring resources (CPU, memory, storage, or bandwidth) for a specific duration. For example, uploading media to Facebook or Instagram triggers several background tasks:
Encoding the photo or video into multiple resolutions.
Validating the media for ...