admin
Get the live token-throughput window
Changed onReturns a fixed, trailing window of token-volume buckets (input / output / prompt-cached / locally-cached) at the requested granularity, for the overview live chart.
get/admin/usage/throughput
Request
- Base URLhttp://localhost:8080
- URLhttp://localhost:8080/admin/usage/throughput
- AuthHTTP bearer
Query parameters
granularitystring required
Bucket granularity: second, minute, hour, day
Response
OK
Changes
- warning
added the new
internal_errorenum value to theresponse property for the response status - warning
added the new
internal_errorenum value to theresponse property for the response status - warning
added the new
internal_errorenum value to theresponse property for the response status
- warning
- warning
added the new
permission_errorenum value to theresponse property for the response status - warning
added the new
permission_errorenum value to theresponse property for the response status - info
added the non-success response with the status
- warning