admin

Get the live token-throughput window

Changed on

Returns a fixed, trailing window of token-volume buckets (input / output / prompt-cached / locally-cached) at the requested granularity, for the overview live chart.

get/admin/usage/throughput

Request

  • Base URL
    http://localhost:8080
  • URL
    http://localhost:8080/admin/usage/throughput
  • Auth
    HTTP bearer

Query parameters

granularitystring required

Bucket granularity: second, minute, hour, day

Response

OK

bucket_secondsinteger
granularitystring

Changes

    • warning

      added the new internal_error enum value to the response property for the response status

    • warning

      added the new internal_error enum value to the response property for the response status

    • warning

      added the new internal_error enum value to the response property for the response status

    • warning

      added the new permission_error enum value to the response property for the response status

    • warning

      added the new permission_error enum value to the response property for the response status

    • info

      added the non-success response with the status