/

Docs
History
Schema
Generate

Filter operations

Audit Logs1

CIDR Lists4

Custom Domains3

Endpoints19

Metrics16

post/v2/endpoint/{namespace}/{name}/metricsGet endpoint metrics [READ]
post/v2/endpoint/{namespace}/{name}/metrics/hardware-cpuGet endpoint hardware CPU and RAM [READ]
post/v2/endpoint/{namespace}/{name}/metrics/hardware-gpuGet endpoint hardware GPU and VRAM [READ]
post/v2/endpoint/{namespace}/{name}/metrics/inference/itlGet endpoint inference inter-token latency [READ]
post/v2/endpoint/{namespace}/{name}/metrics/inference/kv-cacheGet endpoint inference KV cache usage [READ]
post/v2/endpoint/{namespace}/{name}/metrics/inference/prefix-cacheGet endpoint inference prefix cache hit ratio [READ]
post/v2/endpoint/{namespace}/{name}/metrics/inference/requestsGet endpoint inference requests waiting and running [READ]
post/v2/endpoint/{namespace}/{name}/metrics/inference/ttftGet endpoint inference time to first token [READ]
post/v2/endpoint/{namespace}/{name}/metrics/pending-requestGet endpoint pending request [READ]
post/v2/endpoint/{namespace}/{name}/metrics/replica-idsGet endpoint replica ids [READ]
post/v2/endpoint/{namespace}/{name}/metrics/replica-runningGet endpoint replica running [READ]
post/v2/endpoint/{namespace}/{name}/metrics/replica-statusGet endpoint replica status [READ]
post/v2/endpoint/{namespace}/{name}/metrics/response-elapsedGet endpoint response elapsed [READ]
post/v2/endpoint/{namespace}/{name}/metrics/response-status-codeGet endpoint response status code [READ]
post/v2/endpoint/{namespace}/{name}/metrics/response-status-code-groupedGet endpoint response status code grouped [READ]
get/v2/endpoint/{namespace}/{name}/open-metricsGet endpoint OpenMetrics export [READ] [PRO]

Private Services2

Providers3

Metrics

Changes to Get endpoint response elapsed [READ]

post/v2/endpoint/{namespace}/{name}/metrics/response-elapsed

Jul 13, 2026c90598e22977 Revision changes
- info
  endpoint added