Stream completions

Generate text based on the given text prompt.

post/serverless/v1/completions#stream

Request

Base URL
https://api.friendli.ai
Auth
HTTP bearer
TypeScript
https://skmtc.dev/friendli/apis/friendli-suite-api-reference/docs/serverless/v1/completions%23stream/post.ts
A function with typed inputs. Its response is checked against the schema.

X-Friendli-Teamstring nullable

ID of team to run requests as (optional parameter).

{
  "model": "meta-llama/Llama-3.1-8B-Instruct",
  "max_tokens": 200,
  "top_k": 1
}

Successfully generated a chat response.

No recorded changes to this operation across all 1 revision of this API.