workflows

Changed on
post/api/workflow/{agentName}/{workflowName}/evaluation

Request

  • Base URL: / (relative, and the document was published on a file host, not at the API’s origin)
  • URL: /api/workflow/{agentName}/{workflowName}/evaluation
  • Auth: HTTP bearer

Request body

idstring uuid required
judge_instructionsstring

Optional judging instructions or expected workflow output. Sent only to the judge.

timeout_secondsinteger required

Maximum execution time for each workflow run, in seconds.

concurrencyinteger required

Maximum number of executions running or awaiting judgment in this evaluation. Each slot is held until judging finishes.

Response

Workflow executions queued for evaluation.

idstring uuid required
state'queued' | 'running' | 'cancelling' | 'completed' | 'cancelled' required
messagestring
created_atstring date-time required
updated_atstring date-time required
scoring_version'trace-v1' required

Changes

  • c4b6a1d64914Revision changes
    • info

      added the new optional request property

    • info

      added the optional property / to the response with the status

  • 70e873458476Revision changes
    • info

      added the optional property // to the response with the status