Logs & Metrics

Get Live Metrics

Changed on

Get the latest values for the Live metrics section on the web front page.

get/v1/metrics/live

Request

  • Base URL: https://api.deepinfra.com
  • URL: https://api.deepinfra.com/v1/metrics/live
  • Auth: none declared

Response

Successful Response

tokens_per_secondnumber nullable required

Tokens per second

time_to_first_tokennumber nullable required

Time to first token in seconds

requests_per_secondnumber nullable required

Requests per second

total_tflopsnumber nullable required

Total TFLOPS

Changes