Evals

Create Eval Grader

Changed on

Create a grader in the project catalog. Attach it to a prompt with Update Prompt Eval Settings, or pass its name to Create Eval Run.

post/console/v1/eval_graders

Request

  • Base URL
    https://statsigapi.net
  • URL
    https://statsigapi.net/console/v1/eval_graders
  • Auth
    API key in header STATSIG-API-KEY

Request body

namestring required

Grader name, unique in the project.

evalModelstring

OpenAI model that judges a label_model grader, such as gpt-5-mini. Other grader types ignore it. An unsupported model returns a 400. Defaults to gpt-5-mini on create; omit it on update to keep the current model.

Response

Create Eval Grader

messagestring required

A simple string explaining the result of the operation.

Changes