Sign in
Batch

Create a batch

Creates a batch of requests that run asynchronously against a single endpoint (/v1/chat/completions, /v1/responses, /v1/messages, /v1/embeddings). Returns 202 with status: "validating". Poll GET /batches/{id} for progress and results. See the Batch API Quickstart.

post/batches

Request body

completion_window'24h'
endpoint'/v1/chat/completions' | '/v1/responses' | '/v1/messages' | '/v1/embeddings' required
modelstring required

Example request

{
  "provider": {
    "only": [
      "google-vertex"
    ]
  }
}

Response

Batch payload durably persisted and queued for asynchronous validation and provider submission (status: "validating").

BatchObject required— unresolved $ref

Changes

Changed in 2 of the 303 revisions of this API.2