Prompts

Start Prompt Version Evaluation Job

Changed on

Start an offline evaluation of a version against the prompt's eval dataset and graders. The response carries eval_run_id; poll it with Get Prompt Version Eval Run. Fails with 400 when no dataset or grader is attached.

post/console/v1/prompts/{id}/versions/{versionId}/start_evals

Request

  • Base URL
    https://statsigapi.net
  • URL
    https://statsigapi.net/console/v1/prompts/{id}/versions/{versionId}/start_evals
  • Auth
    API key in header STATSIG-API-KEY

Path parameters

versionIdstring required
idstring required

id

Response

Start evaluation job for a Prompt Version

messagestring required

A simple string explaining the result of the operation.

Changes

    • info

      added the non-success response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status