---
title: "Validate Decision Scorer"
method: POST
path: "/v2/scorers/decision/validate"
tags: ["data", "prompts", "rows"]
---

# Validate Decision Scorer

`POST /v2/scorers/decision/validate`

## Request

- Base URL: `https://api.galileo.ai`
- URL: `https://api.galileo.ai/v2/scorers/decision/validate`
- Auth: one of:
  - API key in header `Splunk-AO-API-Key`
  - API key in header `Galileo-API-Key`
  - OAuth 2
    - Password
    - Token URL: `https://api.galileo.ai/login`
  - HTTP basic

Test an unsaved decision evaluator on a query and response typed in the Test tab (Manual Input).

The body has the shape of the log-record test, with `query`, `response` and an optional
`reference_output` in place of the fields that select log records. scoreable_node_types holds
exactly one node type, trace or llm. Poll `GET /generated-scorers/task-results/{task_result_id}`
for the result, as for an LLM test.

## Request body

- ValidateDecisionScorerManualRequest: Test a decision evaluator on one query and response that the user types, before it is saved. The input is text only. The job scores a synthetic trace with one LLM span, or the span alone, at the one node type of scorer_configuration. reference_output is the ground truth. It is needed when scorer_configuration.ground_truth is true, and ignored otherwise.
  - `model_name` string, required
  - `question` string, required
  - `answer_options` union
    - string[]
    - DecisionChoice[]
      - `label` string, required
      - `description` string, nullable
    - DecisionLevel[]
      - `level` integer, required
      - `label` string, required
      - `description` string, nullable
    - DecisionBooleanCriteria: What a true answer and a false answer mean, for a yes/no question. The two are set together.
      - `true` string, required
      - `false` string, required
  - `scorer_configuration` DecisionScorerTestConfiguration, required: The evaluator settings of a decision Test request, the same place as the LLM scorer_configuration. scoreable_node_types holds exactly one node type. input_type defaults to the decision default for it (get_decision_input_type).
    - `output_type` 'boolean' | 'categorical' | 'count' | 'discrete' | 'freeform' | 'percentage' | 'multilabel' | 'retrieved_chunk_list_boolean' | 'boolean_multilabel' | 'boolean_probability', required: Enumeration of output types.
    - `scoreable_node_types` StepType[], required
    - `input_type` 'basic' | 'llm_spans' | 'retriever_spans' | 'sessions_normalized' | 'sessions_trace_io_only' | 'tool_spans' | 'trace_input_only' | 'trace_io_only' | 'trace_normalized' | 'trace_output_only' | 'agent_spans' | 'workflow_spans': Enumeration of input types.
    - `ground_truth` boolean
  - `query` string, required
  - `response` string, required
  - `reference_output` string, nullable

## Response `200`

Successful Response

- GeneratedScorerValidationResponse
  - `task_result_id` string, uuid4, required

## Other responses

- `422`: Validation Error

## Changes

> 34 revisions in range; 2 not diffed.

- **2026-10-19** `0b20eade6391`: 1 info
  - endpoint added

[Operation history](https://skmtc.dev/galileo/apis/galileo-api-server/changes/v2/scorers/decision/validate/post.md)

---

[API](https://skmtc.dev/galileo/apis/galileo-api-server.md) - [All operations](https://skmtc.dev/galileo/apis/galileo-api-server/llms.txt) - [OpenAPI document](https://skmtc.dev/galileo/apis/galileo-api-server/revisions/a289cea1b504?raw)