LLM Providers

Create LLM provider

Register a new LLM provider. API keys can be provided directly or via AWS Secrets Manager ARN for secure credential storage.

post/api/v1/llm-providers

Request

Request body

namestring required

Unique provider name

type'openai' | 'azure-openai' | 'anthropic' | 'bedrock' | 'ollama' | 'gemini' | 'custom' required
api_keystring

API key (mutually exclusive with api_key_secret_arn)

api_key_secret_arnstring

AWS Secrets Manager ARN for API key

endpointstring

API endpoint URL

modelstring

Default model name

regionstring

AWS region (for Bedrock)

enabledboolean
priorityinteger
weightinteger
rate_limitinteger

Max requests per second

timeout_secondsinteger
settingsobject

Response

Provider created

Changes

No recorded changes to this operation across all 1 revision of this API.