Eval runs

Write a finished authoring job's cases into the suite

Writes the job's drafts into the suite. A draft carrying unresolved blocking issues or proposed additions is skipped rather than written, and comes back under skipped with a reviewUrl for finishing it in the app.

A job whose source is markdown — the in-app upload — is not committable here and answers 404: those drafts exist so a person decides on them, and an API commit would decide on their behalf.

post/projects/{projectId}/eval-suites/{suiteId}/authoring/{jobId}/commit

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

suiteIdstring required

Eval suite ID, as returned by POST /eval-runs.

jobIdstring required

Request body

duplicatePolicy'block' | 'warn' | 'create_anyway'

How to treat a case that duplicates one already in the suite. Anything but block requires overrideReason.

overrideReasonstring

Response

The cases written and any the commit skipped, or the job's own status when it finished without committing (failed, cancelled, or still pending at the end of the wait).

OR

Changes

Changed in 1 of the 122 revisions of this API.1