Timeouts Side Effects And Latency problems

Circuit Breaker pattern

Use a generic gateway to provide the template for connection handling, error handling, query execution, and result processing. That way we only need to get it right in one place, and calling code can provide just the essential logic. Collecting this common interaction pattern into a single class also makes it easier to apply the Circuit Breaker pattern. Make full use of the platform. Infrastructure services like Amazon API Gateway can handle many of the dirty details for us. Language runtimes that use callbacks or reactive programming styles also let us specify timeouts more easily.

Timeouts are often found in the company of retries. Under the philosophy of “best effort,” the software attempts to repeat an operation that timed out. Immediately retrying an operation after a failure has a ...