Health Backlog

Returns the number of HTTP requests currently in-flight on this uvicorn worker.

Use this to measure per-pod queue depth. A high value means the worker is processing many concurrent requests — requests arriving now will have to wait for the event loop to get to them, adding latency before LiteLLM even starts its own timer.