IBibm
Models

Create a model (local pod or remote connector)

Changed on

Creates a model deployment. deployment_type=local starts a pod and registers a LiteLLM route asynchronously (202 Accepted). deployment_type=remote registers an external endpoint connector synchronously (201 Created).

post/models

Request

  • Base URL
    https://localhost:8080/api/v1
  • Auth
    API key in header Authorization

Request body

component_typestring required

ComponentType is a catalog component type whose providers have category: models (see the component's metadata.yaml); the valid values come from the catalog.

deployment_type'local' | 'remote' required
modelstring required
namestring required
paramsobject
profilestring
provider_idstring required
worker_namestring

Response

Remote model connector created

idstring

Changes