llm_passthrough

Nvidia Nim Proxy Route

Relay a native NVIDIA NIM request through a LiteLLM model group.

{PROXY_BASE_URL}/nvidia_nim/{model_group}/v1/infer forwards the body unchanged to the deployment's api_base, so object detection and OCR NIMs whose payload carries no model field still go through virtual key auth, model access checks, and spend logging.

post/nvidia_nim/{endpoint}

Request

  • Base URL: https://docs.litellm.com.cn (the document declares no server; this is the origin it was published from)
  • URL: https://docs.litellm.com.cn/nvidia_nim/{endpoint}
  • Auth: API key in header x-litellm-api-key

Path parameters

endpointstring required

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.