TRtransformerlab

batched_prompts

Batch Chat Completion

Predict on a batch of prompts

post/batch/chat/completions

Request

The document declares no server URL.
Auth
none declared
TypeScript
https://skmtc.dev/transformerlab/apis/transformerlab-api/docs/batch/chat/completions/post.ts
A function with typed inputs. Its response is checked against the schema.

Request body

modelstring required

adaptorstring nullable

api_keystring nullable

temperaturenumber

max_tokensinteger

top_pnumber

batch_sizeinteger

inference_urlstring

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 7 revisions of this API.