chat/completions

Chat Completion

Follows the exact same API spec as OpenAI's Chat API https://platform.openai.com/docs/api-reference/chat

curl -X POST http://localhost:4000/v1/chat/completions 
-H "Content-Type: application/json" 
-H "Authorization: Bearer $LITELLM_MASTER_KEY" 
-d '{
    "model": "gpt-4o",
    "messages": [
        {
            "role": "user",
            "content": "Hello!"
        }
    ]
}'
post/engines/{model}/chat/completions

Request

  • Base URL: https://docs.litellm.com.cn (the document declares no server; this is the origin it was published from)
  • URL: https://docs.litellm.com.cn/engines/{model}/chat/completions
  • Auth: API key in header x-litellm-api-key

Path parameters

modelstring nullable required

Request body

modelstring required
frequency_penaltynumber nullable
logit_biasobject nullable
logprobsboolean nullable
top_logprobsinteger nullable
max_tokensinteger nullable
ninteger nullable
presence_penaltynumber nullable
response_formatobject nullable
seedinteger nullable
service_tierstring nullable
stream_optionsobject nullable
temperaturenumber nullable
top_pnumber nullable
toolsobject[] nullable
parallel_tool_callsboolean nullable
functionsobject[] nullable
userstring nullable
streamboolean nullable
metadataobject nullable
guardrailsstring[] nullable
cachingboolean nullable
num_retriesinteger nullable
context_window_fallback_dictobject nullable
fallbacksstring[] nullable

Example request

{
  "messages": [
    {
      "role": "user",
      "content": "Hello, how are you?"
    }
  ]
}

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.