System Design: The Rate Limiter
Let's understand the basic details to design a rate limiter.
We'll cover the following
What is a rate limiter?
A rate limiter, as the name suggests, puts a limit on the number of requests a service fulfills. It throttles requests that cross the predefined limit. For example, a client using a particular service’s API that is configured to allow 500 requests per minute would block further incoming requests for the client if the number of requests the client makes exceeds that limit.