Use of Public Cloud

Buy vs. build decision

The bursty nature of the user population and associated load asks for a Public Cloud for elasticity.

One of the significant benefits of the modern cloud is Scalability of resources—we can request more resources when needed and return them when the load is low. Such scalability allows a service to use computational resources commensurate to the load.

For a specific instance, the load might spike beyond the current capacity. We expect that new resources come online in the order of a few seconds. We might like to keep some spare capacity online and use a good machine-learning-based predictor of required resources.

Job queuing

We need to differentiate between user-facing and ...