health

Health Endpoint

🚨 USE /health/liveliness to health check the proxy 🚨

See more 👉 https://docs.litellm.ai/docs/proxy/health

Check the health of all the endpoints in config.yaml

To run health checks in the background, add this to config.yaml:

general_settings:
    # ... other settings
    background_health_checks: True

else, the health checks will be run on models when /health is called.

To skip deployments that set model_info.disable_background_health_check: true on GET /health as well as in the background loop, set general_settings.health_check_skip_disabled_background_models: true.

get/health

Query parameters

modelstring nullable

Specify the model name (optional)

Specify the model name (optional)

model_idstring nullable

Specify the model ID (optional)

Specify the model ID (optional)

Response

Successful Response

{"stackTrail":"paths:/health:get:responses:200:content:application/json:schema","oasType":"schema","type":"unknown"}

Changes