AAaabiro
Inference

Submit

Changed on

Submit a serverless inference request.

Schedules a short-lived GPU job that runs the specified model on the provided inputs. Returns a job_id to poll for results.

post/api/inference

Request

  • Base URL
    https://xcelsior.ca
  • URL
    https://xcelsior.ca/api/inference
  • Auth
    HTTP bearer

Request body

modelstring required

Model name or HuggingFace repo (e.g. 'distilbert-base-uncased-finetuned-sst-2-english')

gpu_modelstring

Preferred GPU model or 'any'

max_tokensinteger
temperaturenumber
timeout_secinteger

Response

Successful Response

unknown required

Changes