SCscaleapi

Create Completion Stream Task

Changed on

Runs a stream prompt completion on an LLM.

post/v1/llm/completions-stream

Request

  • The document declares no server URL.
  • Auth
    • HTTP basic
    • or OAuth 2
      Password
      Token URL: token

Query parameters

model_endpoint_namestring required

Request body

promptstring required
max_new_tokensinteger required
temperaturenumber required
stop_sequencesstring[] nullable
return_token_log_probsboolean nullable
presence_penaltynumber nullable
frequency_penaltynumber nullable
top_kinteger nullable
top_pnumber nullable
include_stop_str_in_outputboolean nullable
guided_jsonobject nullable
guided_regexstring nullable
guided_choicestring[] nullable
guided_grammarstring nullable
skip_special_tokensboolean nullable

Response

Successful Response

request_idstring nullable required

Changes

  • ea1812999de9Revision changes
    • warning

      removed the optional property // from the response with the status

    • warning

      removed the optional property // from the response with the status