PGpgedge
LLM Proxy

Send a chat request to an LLM

Changed on

Proxies a chat completion request to the specified LLM provider and model. Supports tool definitions for function calling.

post/api/llm/v1/chat

Request

  • The document declares no server URL.
  • Auth
    HTTP bearer

Request body

max_tokensinteger
modelstring

Override default model

providerstring

Override default provider

stop_sequencesstring[]
system_promptstring
temperaturenumber

Response

LLM chat completion response.

stop_reason'end_turn' | 'max_tokens' | 'stop_sequence' | 'tool_use' | 'content_filter' | 'error' required

Changes