Queue

Get queue metrics

Changed on

Get the current queue statistics for a model, including pending and running job counts.

get/v1/queue/metrics

Request

  • Base URL
    https://api.together.ai
  • URL
    https://api.together.ai/v1/queue/metrics
  • Auth
    HTTP bearer

Query parameters

modelstring required

Model name to get metrics for

Response

Queue metrics

messages_runninginteger required

Number of jobs currently being processed

messages_waitinginteger required

Number of jobs waiting to be claimed by a worker

total_jobsinteger required

Total number of active jobs (waiting + running)

Changes