LAlabring
monitor

Get runtime metrics for models and channels

Changed on

Returns runtime rpm/tpm/error metrics sourced from reqlimit and monitor

get/api/monitor/runtime_metrics

Request

  • The document declares no server URL.
  • Auth
    API key in header Authorization

Response

OK

messagestring
successboolean

Changes