data
prompts
rows

Validate Decision Scorer Log Record

Test a decision evaluator on log records. The results go to a new metrics_testing run.

The body has the LLM request's shape (ERD S6). model_name, question and answer_options are at the top level, in place of the prompt fields. output_type, scoreable_node_types, input_type and ground_truth are in scorer_configuration. scoreable_node_types holds exactly one node type. The fields that select the records (log_stream_id or experiment_id, and filters) are at the top level.

post/scorers/decision/validate/log_record

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/scorers/decision/validate/log_record
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Request body

starting_tokeninteger
limitinteger

Records per page, at most 1000. Page through larger result sets with starting_token or previous_last_row_id.

previous_last_row_idstring uuid4 nullable
log_stream_idstring uuid4 nullable

Log stream id associated with the traces.

experiment_idstring uuid4 nullable

Experiment id associated with the traces.

metrics_testing_idstring uuid4 nullable

Metrics testing id associated with the traces.

truncate_fieldsboolean
include_countsboolean

If True, include computed child counts (e.g., num_traces for sessions, num_spans for traces).

include_code_metric_metadataboolean

If True, include per-row scorer metadata (the dict returned alongside the score by code-based scorers via the (score, metadata) tuple-return contract) on each MetricSuccess in the response. Off by default to keep payloads small for callers that don't need it.

model_namestring required
questionstring required

Example request

{
  "filters": [
    {
      "case_sensitive": true,
      "name": "input",
      "operator": "eq",
      "type": "text",
      "value": "example input"
    }
  ],
  "log_stream_id": "00000000-0000-0000-0000-000000000000",
  "pagination": {
    "limit": 5,
    "starting_token": 0
  },
  "sort": {
    "ascending": false,
    "name": "updated_at",
    "sort_type": "column"
  }
}

Response

Successful Response

metrics_experiment_idstring uuid4 required
project_idstring uuid4 required

Changes