health

Health Backlog

Returns the number of HTTP requests currently in-flight on this uvicorn worker.

Use this to measure per-pod queue depth. A high value means the worker is processing many concurrent requests — requests arriving now will have to wait for the event loop to get to them, adding latency before LiteLLM even starts its own timer.

get/health/backlog

Request

  • Base URL
    https://api.flock.io (the document declares no server; this is the origin it was published from)
  • URL
    https://api.flock.io/health/backlog
  • Auth
    API key in header x-litellm-api-key

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 93 revisions of this API.