Get Auto Router Benchmarks
Changed onBenchmarks for the auto-router dashboard: session shape, savings against the configured baseline, and prompt-caching behaviour bucketed by what the router did.
Reads session rollups folded once per request at spend-write time, so this endpoint never scans LiteLLM_SpendLogs. A user filter selects only turns attributed to that internal user when written; older key-only history remains outside user views. Money counts only requests on the selected UTC days, and the all-router savings headline is the same daily total the Overall view reads. Session shape and caching cover every session that overlaps the window, whole. Overall hit rate is over telemetry-bearing turns; each bucket's hit rate is over that bucket's turns.
The rollup supplies the measures, never the list. Which routers appear comes from the model registry, so one shows up as soon as it is configured and reads zero until it serves traffic, and routers_in_scope counts those too rather than only the routers the window recorded.
Request
- Base URL: https://api.sea-lion.ai (the document declares no server; this is the origin it was published from)
- URL: https://api.sea-lion.ai/auto_router/benchmarks
- Auth: API key in header x-litellm-api-key
Query parameters
YYYY-MM-DD UTC, inclusive (defaults to 30 days before end_date)
YYYY-MM-DD UTC, inclusive (defaults to today)
Filter to one virtual key token hash
Filter to one canonical internal user recorded on each turn
Response
Successful Response
Changes
- info
endpoint added
- info