Get Latency Distribution

Changed on

Get latency distribution with percentiles (p1, p5, p10, p25, p50, p75, p90, p95, p99) aggregated by day and model.

Returns latency percentiles for:

  • proxy_latency: Time from request received to upstream call initiated
  • ttft_latency: Time from upstream call to first byte received (Time To First Token)

Defaults to the caller's own data. Admin users (with @quadrillion.io email) may opt into cross-user data by passing user_id (specific user) or all_users=true (everyone). Non-admin requests for other users' data are silently scoped to the caller.

Passing org_id scopes the response to that organization's members and takes precedence over user_id/all_users. It requires platform admin or org admin/owner access (403 otherwise).

get/api/latency_distribution

Request

  • Base URL
    https://api.quadrillion.io (the document declares no server; this is the origin it was published from)
  • URL
    https://api.quadrillion.io/api/latency_distribution
  • Auth
    none declared

Query parameters

user_idinteger nullable

Filter by user ID (admin only)

all_usersboolean

Return data for all users (admin only opt-in)

modelstring nullable

Filter by model name

start_datestring date-time nullable

Start date (ISO 8601)

end_datestring date-time nullable

End date (ISO 8601)

org_idinteger nullable

Scope to an organization's members (org admin only)

Response

Successful Response

Changes

  • 0e2e5be8cbd7Revision changes
    • info

      added the new optional query request parameter org_id

  • abf76937a751Revision changes
    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status