data
prompts
rows

Validate Decision Scorer

Changed on

Test an unsaved decision evaluator on a query and response typed in the Test tab (Manual Input).

The body has the shape of the log-record test, with query, response and an optional reference_output in place of the fields that select log records. scoreable_node_types holds exactly one node type, trace or llm. Poll GET /generated-scorers/task-results/{task_result_id} for the result, as for an LLM test.

post/scorers/decision/validate

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/scorers/decision/validate
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Request body

model_namestring required
questionstring required
querystring required
responsestring required
reference_outputstring nullable

Response

Successful Response

task_result_idstring uuid4 required

Changes