Sign in
Fine-tuning

Run grader

Run a grader.

post/fine_tuning/alpha/graders/run

Request body

itemobject

The dataset item provided to the grader. This will be used to populate the item namespace. See the guide for more details.

model_samplestring required

The model sample to be evaluated. This value will be used to populate the sample namespace. See the guide for more details. The output_json variable will be populated if the model sample is a valid JSON string.

Example request

{
  "grader": {
    "sampling_params": {
      "top_p": 1
    }
  }
}

Response

OK

rewardnumber required
sub_rewardsobject required
model_grader_token_usage_per_modelobject required

Changes