test_runs

Start a test run

Run suites against one publication version. Follow progress, then inspect case verdicts and trial evidence.

Send agent_id, a published version and suite_ids. Use case_ids or trials to select cases or override the trial count. Call test_runs_estimate first to review trial count, cost and duration.

Follow test_runs_get until completion or cancellation. Read test_runs_results for case and assertion verdicts, then test_runs_trial for the transcript and evidence behind a verdict.

post/api/v1/test-runs

Request

  • Base URL: https://api.cumuluslabs.io
  • URL: https://api.cumuluslabs.io/api/v1/test-runs
  • Auth: HTTP bearer

Headers

Idempotency-Keystring required

Request body

agent_idstring required
versioninteger required
suite_idsstring[] required
case_idsstring[]
trialsinteger
baseline_test_run_idstring uuid

Response

Run test suites against one publication version (201; an idempotent replay returns 200)

owner_idstring required
environmentstring required
tenant_idstring uuid required
test_run_idstring uuid required
agent_idstring required
purpose'manual' | 'publish_gate' | 'schedule' | 'release' required
state'queued' | 'running' | 'completed' | 'cancelled' required
verdict'passed' | 'failed' | 'errored' nullable required
baseline_test_run_idstring uuid nullable required
created_atstring date-time required
finished_atstring date-time nullable required

Changes

No recorded changes to this operation across all 1 revision of this API.