APIs
Generators
Stacks
Projects

Docs
History
Schema
Generate

Filter operations

[beta] Agents1

[beta] MCP1

a2a5

a2a_registration1

access_groups10

adaptive_router1

Agent Management5

agent tracing7

agents12

anthropic_passthrough3

anthropic_skills4

assistants16

audio4

Audit Logging2

auto router6

batch12

Budget & Spend Tracking24

budget management7

Cache Settings3

caching4

chat/completions4

claude_code_marketplace8

cloudzero6

completions4

compliance2

config_overrides8

containers18

Coordination Redis Settings3

Cost Optimization1

Cost Tracking8

credential management9

Customer Management13

decisions4

email management3

embeddings4

evals11

experimental1

Fallback Management3

files15

fine-tuning8

gemini_agents5

google genai endpoints14

guardrails25

health19

images6

Internal User management11

jwt_mappings5

key management15

langfuse_passthrough5

Lens46

llm utils4

llm_passthrough121

get/anthropic/{endpoint}Anthropic Proxy Route
put/anthropic/{endpoint}Anthropic Proxy Route
post/anthropic/{endpoint}Anthropic Proxy Route
delete/anthropic/{endpoint}Anthropic Proxy Route
patch/anthropic/{endpoint}Anthropic Proxy Route
get/assemblyai/{endpoint}Assemblyai Proxy Route
put/assemblyai/{endpoint}Assemblyai Proxy Route
post/assemblyai/{endpoint}Assemblyai Proxy Route
delete/assemblyai/{endpoint}Assemblyai Proxy Route
patch/assemblyai/{endpoint}Assemblyai Proxy Route
get/azure/{endpoint}Azure Proxy Route
put/azure/{endpoint}Azure Proxy Route
post/azure/{endpoint}Azure Proxy Route
delete/azure/{endpoint}Azure Proxy Route
patch/azure/{endpoint}Azure Proxy Route
get/azure_ai/{endpoint}Azure Proxy Route
put/azure_ai/{endpoint}Azure Proxy Route
post/azure_ai/{endpoint}Azure Proxy Route
delete/azure_ai/{endpoint}Azure Proxy Route
patch/azure_ai/{endpoint}Azure Proxy Route
get/azure_speech/{endpoint}Azure Speech Proxy Route
put/azure_speech/{endpoint}Azure Speech Proxy Route
post/azure_speech/{endpoint}Azure Speech Proxy Route
delete/azure_speech/{endpoint}Azure Speech Proxy Route
patch/azure_speech/{endpoint}Azure Speech Proxy Route
get/bedrock/{endpoint}Bedrock Proxy Route
put/bedrock/{endpoint}Bedrock Proxy Route
post/bedrock/{endpoint}Bedrock Proxy Route
delete/bedrock/{endpoint}Bedrock Proxy Route
patch/bedrock/{endpoint}Bedrock Proxy Route
post/bespoke/v1/systemoneBespoke Proxy Route
get/cohere/{endpoint}Cohere Proxy Route
put/cohere/{endpoint}Cohere Proxy Route
post/cohere/{endpoint}Cohere Proxy Route
delete/cohere/{endpoint}Cohere Proxy Route
patch/cohere/{endpoint}Cohere Proxy Route
post/comprehendmedicalComprehend Medical Sdk Proxy Route
post/comprehendmedical/{operation}Comprehend Medical Proxy Route
get/cursor/{endpoint}Cursor Proxy Route
put/cursor/{endpoint}Cursor Proxy Route
post/cursor/{endpoint}Cursor Proxy Route
delete/cursor/{endpoint}Cursor Proxy Route
patch/cursor/{endpoint}Cursor Proxy Route
get/eu.assemblyai/{endpoint}Assemblyai Proxy Route
put/eu.assemblyai/{endpoint}Assemblyai Proxy Route
post/eu.assemblyai/{endpoint}Assemblyai Proxy Route
delete/eu.assemblyai/{endpoint}Assemblyai Proxy Route
patch/eu.assemblyai/{endpoint}Assemblyai Proxy Route
get/fal_ai/{endpoint}Fal Ai Proxy Route
put/fal_ai/{endpoint}Fal Ai Proxy Route
post/fal_ai/{endpoint}Fal Ai Proxy Route
delete/fal_ai/{endpoint}Fal Ai Proxy Route
patch/fal_ai/{endpoint}Fal Ai Proxy Route
get/gemini/{endpoint}Gemini Proxy Route
put/gemini/{endpoint}Gemini Proxy Route
post/gemini/{endpoint}Gemini Proxy Route
delete/gemini/{endpoint}Gemini Proxy Route
patch/gemini/{endpoint}Gemini Proxy Route
get/gigachat/{endpoint}Gigachat Proxy Route
put/gigachat/{endpoint}Gigachat Proxy Route
post/gigachat/{endpoint}Gigachat Proxy Route
delete/gigachat/{endpoint}Gigachat Proxy Route
patch/gigachat/{endpoint}Gigachat Proxy Route
post/laya/v1/systemoneLaya Proxy Route
get/milvus/{endpoint}Milvus Proxy Route
put/milvus/{endpoint}Milvus Proxy Route
post/milvus/{endpoint}Milvus Proxy Route
delete/milvus/{endpoint}Milvus Proxy Route
patch/milvus/{endpoint}Milvus Proxy Route
get/mistral/{endpoint}Mistral Proxy Route
put/mistral/{endpoint}Mistral Proxy Route
post/mistral/{endpoint}Mistral Proxy Route
delete/mistral/{endpoint}Mistral Proxy Route
patch/mistral/{endpoint}Mistral Proxy Route
get/nvidia_nim/{endpoint}Nvidia Nim Proxy Route
put/nvidia_nim/{endpoint}Nvidia Nim Proxy Route
post/nvidia_nim/{endpoint}Nvidia Nim Proxy Route
delete/nvidia_nim/{endpoint}Nvidia Nim Proxy Route
patch/nvidia_nim/{endpoint}Nvidia Nim Proxy Route
post/openai/v1/realtime/callsProxy Realtime Calls
post/openai/v1/realtime/client_secretsCreate Realtime Client Secret
post/openai/v1/realtime/transcription_sessionsCreate Realtime Transcription Session
get/openai/{endpoint}Openai Proxy Route
put/openai/{endpoint}Openai Proxy Route
post/openai/{endpoint}Openai Proxy Route
delete/openai/{endpoint}Openai Proxy Route
patch/openai/{endpoint}Openai Proxy Route
get/openrouter/{endpoint}Openrouter Proxy Route
put/openrouter/{endpoint}Openrouter Proxy Route
post/openrouter/{endpoint}Openrouter Proxy Route
delete/openrouter/{endpoint}Openrouter Proxy Route
patch/openrouter/{endpoint}Openrouter Proxy Route
get/tinyfish/{endpoint}Tinyfish Proxy Route
post/tinyfish/{endpoint}Tinyfish Proxy Route
post/transcribeTranscribe Sdk Proxy Route
post/transcribe/{operation}Transcribe Proxy Route
get/typesafe/{endpoint}Typesafe Proxy Route
put/typesafe/{endpoint}Typesafe Proxy Route
post/typesafe/{endpoint}Typesafe Proxy Route
delete/typesafe/{endpoint}Typesafe Proxy Route
patch/typesafe/{endpoint}Typesafe Proxy Route
get/vertex_ai/discovery/{endpoint}Vertex Discovery Proxy Route
put/vertex_ai/discovery/{endpoint}Vertex Discovery Proxy Route
post/vertex_ai/discovery/{endpoint}Vertex Discovery Proxy Route
delete/vertex_ai/discovery/{endpoint}Vertex Discovery Proxy Route
patch/vertex_ai/discovery/{endpoint}Vertex Discovery Proxy Route
get/vertex_ai/{endpoint}Vertex Proxy Route
put/vertex_ai/{endpoint}Vertex Proxy Route
post/vertex_ai/{endpoint}Vertex Proxy Route
delete/vertex_ai/{endpoint}Vertex Proxy Route
patch/vertex_ai/{endpoint}Vertex Proxy Route
get/vllm/{endpoint}Vllm Proxy Route
put/vllm/{endpoint}Vllm Proxy Route
post/vllm/{endpoint}Vllm Proxy Route
delete/vllm/{endpoint}Vllm Proxy Route
patch/vllm/{endpoint}Vllm Proxy Route
get/watsonx/{endpoint}Watsonx Proxy Route
put/watsonx/{endpoint}Watsonx Proxy Route
post/watsonx/{endpoint}Watsonx Proxy Route
delete/watsonx/{endpoint}Watsonx Proxy Route
patch/watsonx/{endpoint}Watsonx Proxy Route

Logging Callbacks2

mcp_byok_oauth9

mcp_discoverable15

mcp_management39

mcp_rest4

memory management5

model management31

model_insights2

moderations2

moyai2

ocr2

OpenAI Pass-through5

organization management16

plugins2

policies10

policy_engine18

project management5

prompts10

public15

rag4

realtime6

rerank3

responses24

Router Settings2

rust control plane1

scim20

search6

search_tools7

Settings6

SSO Settings6

tag management17

team management35

tools8

UI Session1

UI Settings5

UI Theme Settings3

usage_ai1

vantage6

vector_store_management6

vector_stores26

videos18

WebSocket6

workflow management8

get/Home
get/routesGet Routes
get/public/complexity_router/fuse_presetsGet Public Fuse Presets
get/config/pass_through_endpoint/team/{team_id}Get Pass Through Endpoints
get/config/pass_through_endpointGet Pass Through Endpoints
post/config/pass_through_endpointCreate Pass Through Endpoints
delete/config/pass_through_endpointDelete Pass Through Endpoints
post/config/pass_through_endpoint/{endpoint_id}Update Pass Through Endpoints
get/team/availableList Available Teams
get/provider/budgetsProvider Budgets
get/debug/asyncio-tasksGet Active Tasks Stats
get/robots.txtGet Robots
get/litellm/.well-known/litellm-ui-configGet Ui Config
get/.well-known/litellm-ui-configGet Ui Config
get/mcp/proxyProxy Mcp Route
put/mcp/proxyProxy Mcp Route
post/mcp/proxyProxy Mcp Route
delete/mcp/proxyProxy Mcp Route
options/mcp/proxyProxy Mcp Route
head/mcp/proxyProxy Mcp Route
patch/mcp/proxyProxy Mcp Route
get/mcpAggregate Mcp Route
put/mcpAggregate Mcp Route
post/mcpAggregate Mcp Route
delete/mcpAggregate Mcp Route
options/mcpAggregate Mcp Route
head/mcpAggregate Mcp Route
patch/mcpAggregate Mcp Route
get/toolset/{toolset_name}/mcpToolset Mcp Route
put/toolset/{toolset_name}/mcpToolset Mcp Route
post/toolset/{toolset_name}/mcpToolset Mcp Route
delete/toolset/{toolset_name}/mcpToolset Mcp Route
options/toolset/{toolset_name}/mcpToolset Mcp Route
head/toolset/{toolset_name}/mcpToolset Mcp Route
patch/toolset/{toolset_name}/mcpToolset Mcp Route
get/{mcp_server_name}/mcpDynamic Mcp Route
put/{mcp_server_name}/mcpDynamic Mcp Route
post/{mcp_server_name}/mcpDynamic Mcp Route
delete/{mcp_server_name}/mcpDynamic Mcp Route
options/{mcp_server_name}/mcpDynamic Mcp Route
head/{mcp_server_name}/mcpDynamic Mcp Route
patch/{mcp_server_name}/mcpDynamic Mcp Route

llm_passthrough

Changes to Nvidia Nim Proxy Route

delete/nvidia_nim/{endpoint}

Oct 21, 2026f2fb14eab3f5 Revision changes
- info
  endpoint added