Metrics

Get endpoint inference KV cache usage [READ]

Changed on
post/v2/endpoint/{namespace}/{name}/metrics/inference/kv-cache

Request

Path parameters

namespacestring required

User or organization name

namestring required

Endpoint name

Request body

replicaIdstring nullable

Optionally filter by replica ID

startstring date-time required

RFC 3339 Date Format. Ex: 2021-01-01T00:00:00Z

stopstring date-time required

RFC 3339 Date Format. Ex: 2021-01-01T00:00:00Z

Response

Endpoint metric returned successfully

Changes