data
prompts
rows

Create Decision Scorer Version

Changed on

Create a decision evaluator version that holds its question, answer options and model.

post/scorers/{scorer_id}/version/decision

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/scorers/{scorer_id}/version/decision
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Path parameters

scorer_idstring uuid4 required

Request body

model_namestring required
num_judgesinteger nullable
scoreable_node_typesstring[] nullable
cot_enabledboolean nullable
output_type'boolean' | 'categorical' | 'count' | 'discrete' | 'freeform' | 'percentage' | 'multilabel' | 'retrieved_chunk_list_boolean' | 'boolean_multilabel' | 'boolean_probability'

Enumeration of output types.

input_type'basic' | 'llm_spans' | 'retriever_spans' | 'sessions_normalized' | 'sessions_trace_io_only' | 'tool_spans' | 'trace_input_only' | 'trace_io_only' | 'trace_normalized' | 'trace_output_only' | 'agent_spans' | 'workflow_spans'

Enumeration of input types.

questionstring required

Response

Successful Response

idstring uuid4 required
versioninteger required
scorer_idstring uuid4 required
model_namestring nullable
num_judgesinteger nullable
cot_enabledboolean nullable
runtimestring nullable

The runtime a code metric version runs on, such as python3.14. Null for a version saved before runtimes were recorded, which runs on the legacy Python 3.12 runtime.

created_atstring date-time required
updated_atstring date-time required
scoreable_node_typesstring[] nullable
output_type'boolean' | 'categorical' | 'count' | 'discrete' | 'freeform' | 'percentage' | 'multilabel' | 'retrieved_chunk_list_boolean' | 'boolean_multilabel' | 'boolean_probability'

Enumeration of output types.

allowed_modelboolean nullable
created_bystring uuid4 nullable

Changes

  • 0b20eade6391Revision changes
    • info

      added subschema #2 to the request property anyOf list

    • info

      added subschema #2 to the // response property anyOf list for the response status

  • b58d68b6e6f7Revision changes
    • info

      endpoint added