evaluation

Get evaluation job status and results

get/evaluation/{id}/status

Path parameters

idstring required

The ID of the evaluation job to get the status of

Response

Evaluation job status and results retrieved successfully

status'completed' | 'error' | 'user_error' | 'running' | 'queued' | 'pending'

The status of the evaluation job

Example response

{
  "results": {
    "result_file_id": "file-1234-aefd",
    "pass_percentage": 10,
    "label_counts": "{\"yes\": 10, \"no\": 0}"
  }
}

Changes

Changed in 1 of the 14 revisions of this API.13

    • the results/oneOf[EvaluationClassifyResults]/generation_fail_count response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationClassifyResults]/invalid_label_count response's property type/format changed from number/float to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationClassifyResults]/judge_fail_count response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationClassifyResults]/pass_percentage response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationCompareResults]/generation_fail_count response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationCompareResults]/judge_fail_count response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationScoreResults]/aggregated_scores/mean_score response's property type/format changed from number/float to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationScoreResults]/aggregated_scores/pass_percentage response's property type/format changed from number/float to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationScoreResults]/aggregated_scores/std_score response's property type/format changed from number/float to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationScoreResults]/failed_samples response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationScoreResults]/generation_fail_count response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationScoreResults]/invalid_score_count response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    • the results/oneOf[EvaluationScoreResults]/judge_fail_count response's property type/format changed from number/integer to number/ for status 200

      response-property-type-changed

    This revision also has 2 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog