Text Generation Inference
Generate tokens via Chat
Generate tokens via Chat
post/chat/completions
Request body
CompatChatCompletionRequest required— unresolved $ref
Response
Generated Completion
ChatCompletionsResponse required— unresolved $ref
Generate tokens via Chat
Generated Completion