LLM

Proxy to OpenAI-Compatible Chat Completions

Changed on

Proxy requests to OpenAI-compatible chat completions APIs and return the full response payload. Supports multiple providers via model parameter format: "model_name" (defaults to OpenAI), "provider/model_name", or "provider:model_name". Works with providers that offer OpenAI-compatible endpoints.

post/api/llm/openai/chat/completions

Request

  • Base URL
    http://localhost:8000
  • URL
    http://localhost:8000/api/llm/openai/chat/completions
  • Auth
    API key in header Authorization

Request body

modelstring required

Model identifier in format "provider/model-name" (e.g., "openai/gpt-4")

Response

Chat completion response

createdinteger

Unix timestamp of when the completion was created

idstring

Unique identifier for the chat completion

modelstring

The model used for the completion

objectstring

Object type, always "chat.completion"

Changes

  • 5c198c5eb131Revision changes
    • breaking

      the response's body type changed from no type to object for status

    • breaking

      the response's body type changed from no type to object for status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

  • e1ba2ecdbabbRevision changes
    • breaking

      request body became required

    • breaking

      added to the // request property allOf list

    • breaking

      removed the enum value assistant of the request property //

    • breaking

      removed the enum value system of the request property //

    • breaking

      removed the enum value user of the request property //

    • breaking

      the request property's minLength was increased from 0 to 1

    • breaking

      the // request property type changed from string to no type

    • breaking

      the // request property type changed from string to no type

    • info

      added the new optional request property //

    • info

      added the new optional request property //

    • info

      added the media type application/x-www-form-urlencoded to the request body

    • info

      added the media type multipart/form-data to the request body

    • info

      the request property // became nullable

    • info

      the request property // became optional