AAaabiro
Inference v2

Async

Changed on

Asynchronous inference — returns job_id immediately for polling.

post/v1/inference/async

Request

  • Base URL
    https://xcelsior.ca
  • URL
    https://xcelsior.ca/v1/inference/async
  • Auth
    HTTP bearer

Request body

modelstring required

Model name or HuggingFace repo

max_tokensinteger
temperaturenumber
streamboolean

Stream response via SSE

Response

Successful Response

unknown required

Changes