model-hub

post/model-hub/run-prompt/

Request

  • Base URL: http://localhost:8000
  • URL: http://localhost:8000/model-hub/run-prompt/
  • Auth: one of:
    • API key in header X-Api-Key
    • API key in header X-Secret-Key

Request body

dataset_idstring required
modelstring required
namestring required
concurrencyinteger
messagesobject[] required

List of messages with format [{'role': 'user/assistant', 'content': 'text'}]

output_format'array' | 'string' | 'number' | 'object' | 'audio' | 'image'

Output format type. Defaults to 'string'.

temperaturenumber nullable

Controls the randomness. Value between 0 and 1.

frequency_penaltynumber nullable

Penalty for word repetition. Value between -2 and 2.

presence_penaltynumber nullable

Penalty for new word usage. Value between -2 and 2.

max_tokensinteger nullable

Maximum number of tokens to generate. Null = use provider default.

top_pnumber nullable

Controls diversity via nucleus sampling. Value between 0 and 1.

response_formatobject

String or JSON object.

tool_choicestring

Tool selection mode: 'auto' or 'required'.

toolsobject[]

List of tools with tool properties if available.

Response

OK

statusboolean required
resultstring required

Changes

No recorded changes to this operation across all 1 revision of this API.