Metrics

Get system and model inference metrics

Returns a unified snapshot of live system resource metrics (CPU, memory) and per-model moving averages for all pipeline stages (last 100 requests).

get/v1/metrics

Request

  • Base URL
    http://localhost:9001
  • Auth
    none required

Response

Success

modelsobject required

Map of model ID to its moving-average inference metrics. Empty object if no requests have been processed yet.

Changes

No recorded changes to this operation across all 1 revision of this API.