deployments

List deployment test results

Results of each test case from this deployment's test phase, ordered by agent and test name.

Required permission: deployments.test.

get/v1/projects/{project_id}/deployments/{deployment_id}/test-runs

Request

  • Base URL: https://api.connic.co
  • URL: https://api.connic.co/v1/projects/{project_id}/deployments/{deployment_id}/test-runs
  • Auth: HTTP bearer

Path parameters

project_idstring uuid required

ID of the project the API key belongs to.

deployment_idstring uuid required

Deployment ID from GET /deployments.

Query parameters

convert_costs_to'EUR' | 'USD' nullable

Convert token costs to EUR or USD at the daily ECB reference rate of each model call

Response

Successful Response

idstring uuid required
deployment_idstring uuid required

ID of the deployment whose test phase ran this case.

agent_namestring required

Agent under test.

test_namestring required

Test case name from the agent's tests in code.

runsinteger required

Number of agent runs the case executes.

successesinteger required

Number of agent runs that passed so far.

success_thresholdinteger required

Percentage of runs that must pass for the case to pass.

passedboolean required

Whether the case passed; false until it finishes.

failure_reasonstring nullable

Short explanation when the case failed or was cancelled.

agent_run_idsstring[] required

IDs of the agent runs executed for this case, in order.

agent_run_passedboolean[] required

Pass result for each entry in agent_run_ids; null while that run's result is pending.

started_atstring date-time required

When the case was planned at the start of the test phase.

ended_atstring date-time nullable

When the case finished; null while pending or running.

statusstring nullable

pending, running, passed, failed, or cancelled when the deployment was cancelled first.

Changes

No recorded changes to this operation across all 2 revisions of this API.