Chat Completion

Create chat completion with Qwen 32B

Create a chat completion for given messages with streaming support

post/chat/completions

Request body

model'RedHatAI/QwQ-32B-FP8-dynamic' required

Model identifier

streamboolean

Whether to stream the response

temperaturenumber

Sampling temperature

max_tokensinteger

Maximum number of tokens to generate

top_pnumber

Nucleus sampling parameter

stopstring[] nullable

Sequences where the API will stop generating

Successful chat completion

idstring

Unique identifier for the completion