Evaluations

Create an ephemeral evaluation sandbox

Changed on

Creates a separate ephemeral project to evaluate against. The caller must hold the purpose=automation grant issued to a running Code execution, which is what binds the sandbox to code rather than to a person's key. The source project and execution are taken from the grant rather than accepted from the body.

The response contains sandbox metadata and a second, purpose=evaluation grant/data-plane block bound to that sandbox. This target grant can seed and inspect the sandbox and drive its agent, but cannot access another project, account resources, or git routes.

post/api/v2/evaluation-runs

Request

  • Base URL
    https://davinci-app.com
  • Auth
    HTTP bearer

Request body

namestring

Human-readable sandbox name used in logs.

ttlSecondsinteger

Hard cleanup deadline, independent of Code execution timeout.

Response

The target sandbox is ready and its grant has been attached.

runIdstring uuid required
sourceProjectIdstring required
testIdstring nullable

The Test whose Results Value started the Code, when a Test did. Absent for a Code object run directly.

testRunIdstring uuid nullable

The Test run that started the Code, when one did.

codeExecutionIdstring
sessionIdstring uuid

Headless target session attached to the evaluation data-plane grant.

status'provisioning' | 'ready' | 'running' | 'cleaning' | 'cleaned' | 'failed' | 'expired' required

ready means the target is pinned and its grant can be used. failed is an infrastructure failure, not a low quality score. cleaned and expired are terminal and carry no usable grant.

createdAtstring date-time required
expiresAtstring date-time required
updatedAtstring date-time

Changes

    • breaking

      removed the required property //////// from the response with the status

    • breaking

      removed the required property /// from the response with the status

    • info

      added the required property //////// to the response with the status

    • info

      added the required property /// to the response with the status

    • info

      the response property const value false was added for the status

    • info

      the response property const value false was added for the status

    • info

      the response property const value false was added for the status

    • info

      the response property const value false was added for the status

    • info

      the response property const value false was added for the status

    • info

      the response property const value false was added for the status

    • info

      the response property const value false was added for the status

    • info

      the response property const value false was added for the status