Sign in
LLM Configs

Test Llm Config

Run a one-shot test invocation against an LLM configuration and return the model's reply.

The call runs entirely server-side against the persisted config so the (write-only, redacted) api_key never leaves the server. An optional inline config override lets the UI test unsaved edits; a redacted override (api_key=None) reuses the stored secret, mirroring update_llm_config.

Provider/runtime failures are returned as HTTP 200 with success=False and a clean error message (rather than a 500), so the dashboard can render them inline.

post/workflows/v1/llm-configs/{llm_config_id}/test

Path parameters

llm_config_idstring required

Request body

system_promptstring required

Required, non-empty system prompt.

Response

Successful Response

successboolean required
responsestring nullable

Concatenated model output text on success.

errorstring nullable

Clean error message when success is False.

providerstring nullable
modelstring nullable
prompt_tokensinteger nullable
completion_tokensinteger nullable
total_tokensinteger nullable
latency_msinteger nullable
backchannel_responsestring nullable

Backchannel text emitted before the main response, if any.

backchannel_prompt_tokensinteger nullable
backchannel_completion_tokensinteger nullable
backchannel_total_tokensinteger nullable

Changes

Changed in 4 of the 15 revisions of this API.2433

  • 68e88496bf1144See the full diff
    • ●

      removed the request property config/anyOf[subschema #1]/oneOf[subschema #10: Group of regular and backchanneling LLMs]/backchannel_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/oneOf[subschema #6: Custom LLM]/okta_auth

      request-property-removed

    • ●

      removed the request property config/anyOf[subschema #1]/oneOf[subschema #10: Group of regular and backchanneling LLMs]/main_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/oneOf[subschema #6: Custom LLM]/okta_auth

      request-property-removed

    • ●

      removed the request property config/anyOf[subschema #1]/oneOf[subschema #6: Custom LLM]/okta_auth

      request-property-removed

    • ●

      removed the request property config/anyOf[subschema #1]/oneOf[subschema #9: Group of LLMs]/llms/items/oneOf[subschema #6: Custom LLM]/okta_auth

      request-property-removed

    • ○

      added the new optional request property config/anyOf[subschema #1]/oneOf[subschema #10: Group of regular and backchanneling LLMs]/backchannel_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/oneOf[subschema #6: Custom LLM]/integration_auth

      new-optional-request-property

    • ○

      added the new optional request property config/anyOf[subschema #1]/oneOf[subschema #10: Group of regular and backchanneling LLMs]/main_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/oneOf[subschema #6: Custom LLM]/integration_auth

      new-optional-request-property

    • ○

      added the new optional request property config/anyOf[subschema #1]/oneOf[subschema #6: Custom LLM]/integration_auth

      new-optional-request-property

    • ○

      added the new optional request property config/anyOf[subschema #1]/oneOf[subschema #9: Group of LLMs]/llms/items/oneOf[subschema #6: Custom LLM]/integration_auth

      new-optional-request-property

    This revision also has 1 change that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 17cf07b1e7d3111See the full diff
    • ▲

      removed AzureOpenAILLMConfig OpenAILLMConfig GoogleLLMConfig AnthropicLLMConfig BedrockLLMConfig CustomLLMConfig WorkflowDefaultLLMConfig NoLLMConfig LLMGroupConfig LLMGroupWithBackchannelConfig from the config/anyOf[subschema #1]/ request property oneOf list

      request-property-one-of-removed

    • ○

      mapped value for discriminator key anthropic_llm changed from AnthropicLLMConfig to AnthropicLLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key azure_openai_llm changed from AzureOpenAILLMConfig to AzureOpenAILLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key bedrock_llm changed from BedrockLLMConfig to BedrockLLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key custom_llm changed from CustomLLMConfig to CustomLLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key global_default_llm changed from WorkflowDefaultLLMConfig to WorkflowDefaultLLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key google_llm changed from GoogleLLMConfig to GoogleLLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key llm_group changed from LLMGroupConfig to LLMGroupConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key llm_group_with_backchannel changed from LLMGroupWithBackchannelConfig to LLMGroupWithBackchannelConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key no_llm changed from NoLLMConfig to NoLLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key openai_llm changed from OpenAILLMConfig to OpenAILLMConfig-Input for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      added AzureOpenAILLMConfig-Input OpenAILLMConfig-Input GoogleLLMConfig-Input AnthropicLLMConfig-Input BedrockLLMConfig-Input CustomLLMConfig-Input WorkflowDefaultLLMConfig-Input NoLLMConfig-Input LLMGroupConfig-Input LLMGroupWithBackchannelConfig-Input to the config/anyOf[subschema #1]/ request property oneOf list

      request-property-one-of-added

    This revision also has 10 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 9f4e7dc7e0948See the full diff
    • ○

      added bedrock_llm discriminator mapping keys to the config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-added

    • ○

      added bedrock_llm discriminator mapping keys to the config/anyOf[subschema #1]/oneOf[subschema #8: Group of LLMs -> subschema #9: Group of LLMs]/llms/items/ request property

      request-property-discriminator-mapping-added

    • ○

      added bedrock_llm discriminator mapping keys to the config/anyOf[subschema #1]/oneOf[subschema #9: Group of regular and backchanneling LLMs -> subschema #10: Group of regular and backchanneling LLMs]/backchannel_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/ request property

      request-property-discriminator-mapping-added

    • ○

      added bedrock_llm discriminator mapping keys to the config/anyOf[subschema #1]/oneOf[subschema #9: Group of regular and backchanneling LLMs -> subschema #10: Group of regular and backchanneling LLMs]/main_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/ request property

      request-property-discriminator-mapping-added

    • ○

      added BedrockLLMConfig to the config/anyOf[subschema #1]/ request property oneOf list

      request-property-one-of-added

    • ○

      added BedrockLLMConfig to the config/anyOf[subschema #1]/oneOf[subschema #8: Group of LLMs -> subschema #9: Group of LLMs]/llms/items/ request property oneOf list

      request-property-one-of-added

    • ○

      added BedrockLLMConfig to the config/anyOf[subschema #1]/oneOf[subschema #9: Group of regular and backchanneling LLMs -> subschema #10: Group of regular and backchanneling LLMs]/backchannel_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/ request property oneOf list

      request-property-one-of-added

    • ○

      added BedrockLLMConfig to the config/anyOf[subschema #1]/oneOf[subschema #9: Group of regular and backchanneling LLMs -> subschema #10: Group of regular and backchanneling LLMs]/main_llm_config/anyOf[subschema #1: Group of LLMs]/llms/items/ request property oneOf list

      request-property-one-of-added

  • 51c1cdb1d9a5110See the full diff
    • ▲

      removed AzureOpenAILLMConfig-Input OpenAILLMConfig-Input GoogleLLMConfig-Input AnthropicLLMConfig-Input CustomLLMConfig-Input WorkflowDefaultLLMConfig-Input NoLLMConfig-Input LLMGroupConfig-Input LLMGroupWithBackchannelConfig-Input from the config/anyOf[subschema #1]/ request property oneOf list

      request-property-one-of-removed

    • ○

      mapped value for discriminator key anthropic_llm changed from AnthropicLLMConfig-Input to AnthropicLLMConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key azure_openai_llm changed from AzureOpenAILLMConfig-Input to AzureOpenAILLMConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key custom_llm changed from CustomLLMConfig-Input to CustomLLMConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key global_default_llm changed from WorkflowDefaultLLMConfig-Input to WorkflowDefaultLLMConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key google_llm changed from GoogleLLMConfig-Input to GoogleLLMConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key llm_group changed from LLMGroupConfig-Input to LLMGroupConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key llm_group_with_backchannel changed from LLMGroupWithBackchannelConfig-Input to LLMGroupWithBackchannelConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key no_llm changed from NoLLMConfig-Input to NoLLMConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      mapped value for discriminator key openai_llm changed from OpenAILLMConfig-Input to OpenAILLMConfig for config/anyOf[subschema #1]/ request property

      request-property-discriminator-mapping-changed

    • ○

      added AzureOpenAILLMConfig OpenAILLMConfig GoogleLLMConfig AnthropicLLMConfig CustomLLMConfig WorkflowDefaultLLMConfig NoLLMConfig LLMGroupConfig LLMGroupWithBackchannelConfig to the config/anyOf[subschema #1]/ request property oneOf list

      request-property-one-of-added

    This revision also has 18 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog