MCmcpjam
Eval runs

Write a finished authoring job's cases into the suite

Changed on

Writes the job's drafts into the suite. A draft carrying unresolved blocking issues or proposed additions is skipped rather than written, and comes back under skipped with a reviewUrl for finishing it in the app.

A job whose source is markdown — the in-app upload — is not committable here and answers 404: those drafts exist so a person decides on them, and an API commit would decide on their behalf.

post/projects/{projectId}/eval-suites/{suiteId}/authoring/{jobId}/commit

Request

Path parameters

projectIdstring required

ID of the hosted project that contains the server.

suiteIdstring required

Eval suite ID, as returned by POST /eval-runs.

jobIdstring required

Request body

duplicatePolicy'block' | 'warn' | 'create_anyway'

How to treat a case that duplicates one already in the suite. Anything but block requires overrideReason.

overrideReasonstring

Response

The cases written and any the commit skipped, or the job's own status when it finished without committing (failed, cancelled, or still pending at the end of the wait).

OR

Changes

  • bf355f10845cRevision changes
    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

    • warning

      added the new AUTH_REQUIRED enum value to the response property for the response status

  • 9826d734d268Revision changes
    • info

      added the optional property //////// to the response with the status

    • info

      added the optional property //////// to the response with the status

    • info

      added to the //////// response property allOf list for the response status

    • info

      added to the //////// response property allOf list for the response status

    • info

      removed from the //////// response property allOf list for the response status

    • info

      removed from the //////// response property allOf list for the response status

    • info

      the response required property //////// became read-only for the status

    • info

      the response required property //////// became read-only for the status