LoRAX

OpenAI Completions v1 compatible endpoint

post/v1/completions

Request body

modelstring

promptstring

temperaturenumber float nullable

top_pnumber float nullable

ninteger nullable

max_tokensinteger

stopstring[]

streamboolean

adapter_sourcestring nullable

api_tokenstring nullable

Example request

{
  "model": "alignment-handbook/zephyr-7b-dpo-lora",
  "prompt": "What is deep learning?",
  "temperature": 0.5,
  "top_p": 0.95,
  "n": 3,
  "stop": [
    "photographer"
  ]
}

Response

Generated Text

idstring

objectstring

createdinteger

modelstring

Changes

Changed in 4 of the 14 revisions of this API.137

Jul 17, 2026d56749eaa5c434See the full diff
- ●
  the n request property's min was set to 0.00
  request-property-min-set
- ●
  the temperature request property's min was set to 0.00
  request-property-min-set
- ●
  the top_p request property's min was set to 0.00
  request-property-min-set
- ○
  the max_tokens request property's exclusiveMinimum was decreased from 0.00 to true
  request-property-exclusive-min-decreased
- ○
  the n request property's exclusiveMinimum was decreased from 0.00 to true
  request-property-exclusive-min-decreased
- ○
  the temperature request property's exclusiveMinimum was decreased from 0.00 to false
  request-property-exclusive-min-decreased
- ○
  the top_p request property's exclusiveMinimum was decreased from 0.00 to true
  request-property-exclusive-min-decreased
Apr 29, 202404ad4acad6812See the full diff
- ○
  added the new optional request property adapter_source
  new-optional-request-property
- ○
  added the new optional request property api_token
  new-optional-request-property
Jan 10, 20242146c034dd751See the full diff
- ○
  endpoint added
  endpoint-added
Dec 7, 2023a775339b49381See the full diff
- ▲
  api path removed without deprecation
  api-path-removed-without-deprecation
This revision also has 14 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

Full history