Queue

Submit a queued job

Changed on

Submit a new job to the queue for asynchronous processing. Jobs are processed in strict priority order (higher priority first, FIFO within the same priority). Returns a request ID that can be used to poll status or cancel the job.

post/v1/queue/submit

Request

  • Base URL
    https://api.together.ai
  • URL
    https://api.together.ai/v1/queue/submit
  • Auth
    HTTP bearer

Request body

infoobject

Arbitrary JSON metadata stored with the job. Returned in status responses, where the model and system may have added or modified keys (e.g. progress).

modelstring required

Required model identifier

payloadobject required

Freeform model input. Passed unchanged to the model. Contents are model-specific.

priorityinteger

Job priority. Higher values are processed first (strict priority ordering). Jobs with equal priority are processed in submission order (FIFO).

Example request

{
  "model": "my-queue-model"
}

Response

Successfully queued request

requestIdstring required

Unique identifier for the submitted job. Use this to poll status or cancel.

Changes