/
HU
huggingface
Search skmtc…
⌘K
Docs
Sign in
Docs
History
Schema
Generate
Filter operations
Audit Logs
1
CIDR Lists
4
Custom Domains
3
Endpoints
19
Metrics
16
post
/v2/endpoint/{namespace}/{name}/metrics
Get endpoint metrics [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/hardware-cpu
Get endpoint hardware CPU and RAM [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/hardware-gpu
Get endpoint hardware GPU and VRAM [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/inference/itl
Get endpoint inference inter-token latency [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/inference/kv-cache
Get endpoint inference KV cache usage [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/inference/prefix-cache
Get endpoint inference prefix cache hit ratio [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/inference/requests
Get endpoint inference requests waiting and running [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/inference/ttft
Get endpoint inference time to first token [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/pending-request
Get endpoint pending request [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/replica-ids
Get endpoint replica ids [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/replica-running
Get endpoint replica running [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/replica-status
Get endpoint replica status [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/response-elapsed
Get endpoint response elapsed [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/response-status-code
Get endpoint response status code [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/response-status-code-grouped
Get endpoint response status code grouped [READ]
get
/v2/endpoint/{namespace}/{name}/open-metrics
Get endpoint OpenMetrics export [READ] [PRO]
Private Services
2
Providers
3
Metrics
Copy
Copy Markdown
Copy Markdown
Copying…
Copied
Copy failed
Changes to Get endpoint inference inter-token latency [READ]
post
/v2/endpoint/{namespace}/{name}/metrics/inference/itl
Sep 18, 2026
737c5c190b57
Revision changes
info
endpoint added