How Databricks Scales Up a Queue

At Databricks, there's a bunch of auto scaling concepts whether it be on compute, or in sort of a sequel endpoint. And essentially what happens on the back end is we have a gateway that cues into different compute resources and if that gateway has a very large queue, it then scales up the compute resources. If the queue is too large or too small, it'll scale up or scale down accordingly.