Inference Providers

Create LiteLLM gateway provider

Changed on

Connects the organization's own LiteLLM proxy and syncs its models. mode=org stores one organization LiteLLM key used for everyone, creates an "All LiteLLM models" group granted to the given audiences, and keeps OpenWork spend tracking and limits on. mode=member stores a LiteLLM admin key used only to sync models and teams; each person then connects their own LiteLLM key, which picks the shared group matching that key's models. The given audiences are granted the empty "Can connect a LiteLLM key" group, and OpenWork spend tracking is off because LiteLLM budgets those keys. Keys are write-only. Requires the Manage Gateway providers permission and Gateway management; session callers must recently reauthenticate.

post/v1/inference-providers/litellm

Request

  • Base URL: https://api.openworklabs.com
  • URL: https://api.openworklabs.com/v1/inference-providers/litellm
  • Auth: one of:
    • API key in header x-api-key
    • HTTP bearer

Request body

namestring
baseUrlstring required

LiteLLM proxy URL, with or without /v1.

mode'org' | 'member' | 'issued' required

org: one organization LiteLLM key for everyone, with OpenWork spend tracking. member: each person connects their own LiteLLM key. issued: OpenWork creates a LiteLLM key for each allowed person, found by their OpenWork email. In member and issued modes apiKey is a LiteLLM admin key and OpenWork spend tracking is off.

issueStrategy'per_team' | 'mirror'

issued mode. per_team: one key per LiteLLM team the person belongs to, or one key without a team when they are in none. mirror: a copy of their oldest active key (team, models, aliases, tags, expiry; never key-level budgets or rate limits).

mirrorFallback'per_team' | 'error'

issued + mirror: for someone with no key to copy, create per-team keys, or report them and create nothing.

apiKeystring required

Organization key (org mode) or admin key (member and issued modes). Write-only.

allMembersboolean
memberIdsstring[]
teamIdsstring[]

Response

Create LiteLLM gateway provider

Changes

  • 7fd134946207Revision changes
    • info

      added the required property / to the response with the status

  • cc8a41bb846eRevision changes
    • info

      added the optional property / to the response with the status