WAwandb
Evaluations

Evaluation Create

Changed on

Create an evaluation object.

post/v2/{entity}/{project}/evaluations

Request

  • Base URL
    https://trace.wandb.ai (the document declares no server; this is the origin it was published from)
  • URL
    https://trace.wandb.ai/v2/{entity}/{project}/evaluations
  • Auth
    none declared

Path parameters

entitystring required
projectstring required

Request body

namestring required

The name of this evaluation. Evaluations with the same name will be versioned together.

descriptionstring nullable

A description of this evaluation

datasetstring required

Reference to the dataset (weave:// URI)

scorersstring[] nullable

List of scorer references (weave:// URIs)

trialsinteger

Number of trials to run

evaluation_namestring nullable

Name for the evaluation run

eval_attributesobject nullable

Optional attributes for the evaluation

Response

Successful Response

digeststring required

The digest of the created evaluation

object_idstring required

The ID of the created evaluation

version_indexinteger required

The version index of the created evaluation

evaluation_refstring required

Full reference to the created evaluation

Changes

  • dd89fadfe4e4Revision changes
    • info

      the endpoint scheme security HTTPBasic was removed from the API

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

  • 56745769989bRevision changes
    • info

      endpoint added