data
prompts
rows

Validate Decision Scorer Dataset

Changed on

Test a decision evaluator on dataset rows. The results go to a new metrics_testing run.

The evaluator fields have the shape of the log record request. dataset_id, dataset_version_index, limit and starting_token select the rows, as in the LLM dataset request. scoreable_node_types holds one node type, trace or llm. Read the results with metric_key=decision_scorer_validation.

post/scorers/decision/validate/dataset

Request

  • Base URL
    https://api.galileo.ai
  • URL
    https://api.galileo.ai/scorers/decision/validate/dataset
  • Auth
    • API key in header Splunk-AO-API-Key
    • or API key in header Galileo-API-Key
    • or OAuth 2
      Password
      Token URL: https://api.galileo.ai/login
    • or HTTP basic

Request body

dataset_idstring uuid4 required
dataset_version_indexinteger nullable
limitinteger

Maximum number of dataset rows to process.

starting_tokeninteger nullable

Pagination offset into dataset rows.

model_namestring required
questionstring required

Response

Successful Response

metrics_experiment_idstring uuid4 required
project_idstring uuid4 required

Changes