Evals

Start a run on an existing eval that scores a dataset with the named graders. Poll Get Eval Run until its status is completed, then read its results.

post/console/v1/evals/{name}

Request

  • Base URL
    https://statsigapi.net
  • URL
    https://statsigapi.net/console/v1/evals/{name}
  • Auth
    API key in header STATSIG-API-KEY

Path parameters

namestring required

name

Request body

namestring required

The Eval Run display name

gradersstring[] required

The list of grader names

datasetstring required

The dataset name

Example request

{
  "name": "my_eval_run",
  "graders": [
    "grader1",
    "grader2"
  ],
  "dataset": "dataset1"
}

Response

Create Eval Run

messagestring required

A simple string explaining the result of the operation.

Changes