LLM Configs

Test Llm Config Inline

Changed on

Run a one-shot test invocation against a fully inline LLM configuration that has not been persisted yet (the create flow), and return the model's reply.

Because there is no stored record to recover secrets from, the provider api_key must be supplied in body.config (or omitted to fall back to the team's stored vendor credentials). Provider/runtime failures are returned as HTTP 200 with success=False and a clean error message, mirroring the saved-config test endpoint, so the dashboard can render them inline.

post/workflows/v1/llm-configs/test

Request

  • Base URL
    https://api-qa.interactly.ai
  • URL
    https://api-qa.interactly.ai/workflows/v1/llm-configs/test
  • Auth
    HTTP bearer

Request body

system_promptstring required

Required, non-empty system prompt.

Response

Successful Response

successboolean required
responsestring nullable

Concatenated model output text on success.

errorstring nullable

Clean error message when success is False.

providerstring nullable
modelstring nullable
prompt_tokensinteger nullable
completion_tokensinteger nullable
total_tokensinteger nullable
latency_msinteger nullable
used_user_api_keyboolean nullable

Whether this call was made with the team's own saved provider key rather than the deployment's. Null for a group, whose members decide separately, and when the call never got as far as a client.

error_categorystring nullable

On failure, what kind it was, read from the provider's error: auth, permission, quota, rate_limit, model, timeout, unavailable or other.

backchannel_responsestring nullable

Backchannel text emitted before the main response, if any.

backchannel_prompt_tokensinteger nullable
backchannel_completion_tokensinteger nullable
backchannel_total_tokensinteger nullable

Changes

    • info

      added the optional property to the response with the status

    • info

      added the optional property to the response with the status

    • info

      added the new optional request property //

    • info

      added the new optional request property /////

    • info

      added the new optional request property ///////

    • info

      added the new optional request property ///////

    • info

      added the new gpt-audio-1.5 enum value to the request property //////

    • info

      added the new gpt-audio-1.5 enum value to the request property ////////

    • info

      added the new gpt-audio-1.5 enum value to the request property ////////

    • info

      added the new gpt-audio-1.5 enum value to the request property ///

    • info

      added the new gpt-audio-mini enum value to the request property //////

    • info

      added the new gpt-audio-mini enum value to the request property ////////

    • info

      added the new gpt-audio-mini enum value to the request property ////////

    • info

      added the new gpt-audio-mini enum value to the request property ///