Evals

Create Eval Dataset

Create a dataset, optionally with rows. Columns are taken from the row cells; rows may record the production trace they came from.

post/console/v1/eval_datasets

Request

namestring required

Dataset name, unique in the project.

descriptionstring

outputFieldsstring[]

Column names that hold outputs to grade instead of generating completions.

Create Eval Dataset

messagestring required

A simple string explaining the result of the operation.