Regional

Get async queue status for a regional environment.

get/async_queue_status

Request

Base URL
https://model-{model_id}.api.baseten.co
Auth
HTTP bearer
TypeScript
https://skmtc.dev/baseten/apis/baseten-inference-api/docs/async_queue_status/get.ts
A function with typed inputs. Its response is checked against the schema.

Async queue status for a deployment.

model_idstring required

The ID of the model.

deployment_idstring required

The ID of the deployment.

num_queued_requestsinteger required

Number of requests with QUEUED status awaiting processing.

num_in_progress_requestsinteger required

Number of requests currently being processed by the model.

No recorded changes to this operation across all 1 revision of this API.