Test Model Connection

Test a direct connection to a specific model.

This endpoint allows you to verify if your proxy can successfully connect to a specific model. It's useful for troubleshooting model connectivity issues without going through the full proxy routing.

Example:

curl -X POST 'http://localhost:4000/health/test_connection' \
  -H 'Authorization: Bearer sk-1234' \
  -H 'Content-Type: application/json' \
  -d '{
    "litellm_params": {
        "model": "gpt-4",
        "custom_llm_provider": "azure_ai",
        "litellm_credential_name": null,
        "api_key": "6xxxxxxx",
        "api_base": "https://litellm8397336933.openai.azure.com/openai/deployments/gpt-4o/chat/completions?api-version=2024-10-21",
    },
    "mode": "chat"
  }'

Returns: dict: A dictionary containing the health check result with either success information or error details.