llm_passthrough

Nvidia Nim Proxy Route

Changed on

Relay a native NVIDIA NIM request through a LiteLLM model group.

{PROXY_BASE_URL}/nvidia_nim/{model_group}/v1/infer forwards the body unchanged to the deployment's api_base, so object detection and OCR NIMs whose payload carries no model field still go through virtual key auth, model access checks, and spend logging.

delete/nvidia_nim/{endpoint}

Request

  • Base URL: https://api.sea-lion.ai (the document declares no server; this is the origin it was published from)
  • URL: https://api.sea-lion.ai/nvidia_nim/{endpoint}
  • Auth: API key in header x-litellm-api-key

Path parameters

endpointstring required

Response

Successful Response

unknown required

Changes