VEvectorize
LLM Traces

LLM request statistics

Changed on

Get LLM request counts grouped by time bucket and status for charting. Only requests within HINDSIGHT_API_LLM_TRACE_RETENTION_DAYS are kept, so a period longer than retention_days (in the response; null = kept forever) only covers the last retention_days.

get/v1/default/banks/{bank_id}/llm-requests/stats

Request

Path parameters

bank_idstring required

Query parameters

operationstring nullable

Filter by operation

call_type'llm' | 'embedding' | 'rerank' | 'decision' nullable

Filter by kind of model call: llm, embedding, rerank or decision

periodstring

Time period: 1d (by hour), 7d, or 30d (by day)

split_by'model' | 'operation' nullable

Also split each bucket by model or by operation (returned in series)

Headers

authorizationstring nullable

Response

Successful Response

bank_idstring required
periodstring required
truncstring required
startstring required
retention_daysinteger nullable

Changes

  • 45e711cd0897Revision changes
    • info

      added the new optional query request parameter call_type

    • info

      added the new optional query request parameter split_by

    • info

      added the optional property // to the response with the status

    • info

      added the optional property to the response with the status

  • 4fda98b75f63Revision changes
    • info

      endpoint added