ABExperimentService5

Account1

Audio5

Batches4

Chat1

Code Interpreter2

Completion1

ConfigService2

Deployments6

DeploymentService10

DeploymentsStorage2

DeploymentsVolumes2

Embeddings1

endpoints1

Endpoints8

EndpointService9

evaluation5

Files5

Fine-tuning14

GPUClusterService5

Hardware1

HealthCheckService1

Images1

InstanceClusterAddOnService5

InstanceTypeService2

Jobs2

Models2

PlacementProfileService2

Queue5

postCancel a queued job
postClear a model's pending jobs
getGet queue metrics
getGet job status
postSubmit a queued job

RegionService1

RemediationService6

Rerank1

RL28

RolloutService10

Secrets5

ShadowExperimentService10

SharedVolumeService5

SupportedModelsService2

Video2

Voices1

Volumes3

VolumeService13

Queue

Get queue metrics

Get the current queue statistics for a model, including pending and running job counts.

get/queue/metrics

Query parameters

modelstring required

Model name to get metrics for

Response

Queue metrics

messages_runninginteger required

Number of jobs currently being processed

messages_waitinginteger required

Number of jobs waiting to be claimed by a worker

total_jobsinteger required

Total number of active jobs (waiting + running)

Get queue metrics

Query parameters

Response

Changes