Sign in
Internal

Attach a managed-provider backend to the model (platform admin)

Adds one managed third-party backend (bedrock/openrouter/openai/anthropic) to the catalog row. Self-hosted capacity is NOT created here: pool:// endpoints are registrar-owned by serving deployments and attaching one by hand is refused. New backends start healthy at the given weight (default 0, the overflow tail), so attaching never moves traffic by itself.

post/v1/admin/inference/catalog/{modelId}/backends

Path parameters

modelIdstring required

Request body

auth'none' | 'bedrock_api_key' | 'api_key' | 'anthropic'

Auth STYLE the gateway applies to this backend's requests. anthropic sends x-api-key + anthropic-version headers (required by Anthropic- dialect upstreams); api_key sends Authorization: Bearer.

endpointstring required
maxConcurrencyinteger
nativeFamiliesstring[] required
provider'bedrock' | 'openrouter' | 'openai' | 'anthropic' required

Managed providers only; self-hosted capacity attaches through serving deployments

refstring required

Provider-side model id

transport'direct' | 'tunnel' | 'privatelink'
weightinteger

Starting weight; 0 keeps the backend in the overflow tail so attaching moves no traffic

Response

Attached

enabledboolean
modelIdstring required
statusstring
updatedAtstring

Changes

Changed in 1 of the 19 revisions of this API.1