INinteractly
LLM Configs

Test Llm Config

Changed on

Run a one-shot test invocation against an LLM configuration and return the model's reply.

The call runs entirely server-side against the persisted config so the (write-only, redacted) api_key never leaves the server. An optional inline config override lets the UI test unsaved edits; a redacted override (api_key=None) reuses the stored secret, mirroring update_llm_config.

Provider/runtime failures are returned as HTTP 200 with success=False and a clean error message (rather than a 500), so the dashboard can render them inline.

post/workflows/v1/llm-configs/{llm_config_id}/test

Request

  • Base URL
    https://api-qa.interactly.ai
  • URL
    https://api-qa.interactly.ai/workflows/v1/llm-configs/{llm_config_id}/test
  • Auth
    HTTP bearer

Path parameters

llm_config_idstring required

Request body

system_promptstring required

Required, non-empty system prompt.

Response

Successful Response

successboolean required
responsestring nullable

Concatenated model output text on success.

errorstring nullable

Clean error message when success is False.

providerstring nullable
modelstring nullable
prompt_tokensinteger nullable
completion_tokensinteger nullable
total_tokensinteger nullable
latency_msinteger nullable
used_user_api_keyboolean nullable

Whether this call was made with the team's own saved provider key rather than the deployment's. Null for a group, whose members decide separately, and when the call never got as far as a client.

error_categorystring nullable

On failure, what kind it was, read from the provider's error: auth, permission, quota, rate_limit, model, timeout, unavailable or other.

backchannel_responsestring nullable

Backchannel text emitted before the main response, if any.

backchannel_prompt_tokensinteger nullable
backchannel_completion_tokensinteger nullable
backchannel_total_tokensinteger nullable

Changes

  • 5793b8de56f0Revision changes
    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

  • 313ea3ccd136Revision changes
    • info

      added the new optional request property ///

    • info

      added the new optional request property //////

    • info

      added the new optional request property ////////

    • info

      added the new optional request property ////////

    • info

      added the new gpt-audio-1.5 enum value to the request property ///////

    • info

      added the new gpt-audio-1.5 enum value to the request property /////////

    • info

      added the new gpt-audio-1.5 enum value to the request property /////////

    • info

      added the new gpt-audio-1.5 enum value to the request property ////

    • info

      added the new gpt-audio-mini enum value to the request property ///////

    • info

      added the new gpt-audio-mini enum value to the request property /////////

    • info

      added the new gpt-audio-mini enum value to the request property /////////

    • info

      added the new gpt-audio-mini enum value to the request property ////