---
title: "Nvidia Nim Proxy Route"
method: PATCH
path: "/nvidia_nim/{endpoint}"
tags: ["llm_passthrough"]
---

# Nvidia Nim Proxy Route

`PATCH /nvidia_nim/{endpoint}`

## Request

- Base URL: `https://api.sea-lion.ai` (the document declares no server; this is the origin it was published from)
- URL: `https://api.sea-lion.ai/nvidia_nim/{endpoint}`
- Auth: API key in header `x-litellm-api-key`

Relay a native NVIDIA NIM request through a LiteLLM model group.

`{PROXY_BASE_URL}/nvidia_nim/{model_group}/v1/infer` forwards the body unchanged to the deployment's
`api_base`, so object detection and OCR NIMs whose payload carries no `model` field still go through
virtual key auth, model access checks, and spend logging.

## Path parameters

- `endpoint` string, required

## Response `200`

Successful Response

- unknown

## Other responses

- `422`: Validation Error

## Changes

- **2026-10-21** `f2fb14eab3f5`: 1 info
  - endpoint added

[Operation history](https://skmtc.dev/sea-lion/apis/litellm-api/changes/nvidia_nim/:endpoint/patch.md)

---

[API](https://skmtc.dev/sea-lion/apis/litellm-api.md) · [All operations](https://skmtc.dev/sea-lion/apis/litellm-api/llms.txt) · [OpenAPI document](https://skmtc.dev/sea-lion/apis/litellm-api/revisions/f2fb14eab3f5?raw)