ABExperimentService5

Account1

Audio5

Batches4

Billing1

Chat1

Code Interpreter2

Completion1

ConfigService2

Deployments6

DeploymentService10

DeploymentsStorage2

DeploymentsVolumes2

Embeddings1

endpoints1

Endpoints8

EndpointService9

evaluation5

Files5

Fine-tuning14

GPUClusterService5

Hardware1

HealthCheckService1

Images1

InstanceClusterAddOnService5

InstanceTypeService2

Jobs2

Models2

PlacementProfileService2

Queue5

RegionService1

RemediationService6

Rerank1

RL29

RolloutService10

Secrets5

ShadowExperimentService10

SharedVolumeService5

SupportedModelsService2

Video2

Voices1

Volumes3

VolumeService13

Queue

Get queue metrics

Get the current queue statistics for a model, including pending and running job counts.

get/queue/metrics

Query parameters

modelstring required

Model name to get metrics for

Response

Queue metrics

messages_runninginteger required

Number of jobs currently being processed

messages_waitinginteger required

Number of jobs waiting to be claimed by a worker

total_jobsinteger required

Total number of active jobs (waiting + running)

Changes

No recorded changes to this endpoint across all 14 revisions of this API.