NVIDIA NIM Pass-through
pass-through

Nvidia Nim Proxy Route

Relay a native NVIDIA NIM request through a LiteLLM model group.

{PROXY_BASE_URL}/nvidia_nim/{model_group}/v1/infer forwards the body unchanged to the deployment's api_base, so object detection and OCR NIMs whose payload carries no model field still go through virtual key auth, model access checks, and spend logging.

delete/nvidia_nim/{endpoint}

Request

  • Base URL: https://apiclaw.biz (the document declares no server; this is the origin it was published from)
  • URL: https://apiclaw.biz/nvidia_nim/{endpoint}
  • Auth: API key in header x-litellm-api-key

Path parameters

endpointstring required

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.