Test Runs

Retrieves the full details of a single test run by jobId, scoped to the specified batch and agent. Returns the test case name, execution status, expected and actual outcomes, and transcript details.

get/v1/test-runs/{jobId}

Request

  • Base URL
    https://api.sigmamind.ai
  • Auth
    API key in header X-API-Key

Path parameters

jobIdstring required

The unique identifier of the simulation run to retrieve.

Query parameters

batchIdstring required

The unique identifier of the batch run to which this simulation run belongs.

agentIdstring required

Unique identifier of the agent to which the batch run belongs.

Response

OK

batchIdstring

The unique identifier of the batch run this simulation attempt belongs to.

workspaceIdstring

The unique identifier of the workspace under which this simulation attempt was created.

jobIdstring

The unique identifier of this individual simulation attempt within the batch run.

chatIdstring

The unique identifier of the chat session generated during this simulation run.

createdDatestring date-time

The UTC timestamp indicating when this simulation run was initiated.

completedDatestring date-time

The UTC timestamp indicating when this simulation run was completed.

isSuccessfulboolean

Indicates whether the Agent met the success criteria during this simulation run.

remarksstring

A plain-language explanation of why a goal failed. This is the root cause, separate from which goals passed or failed.

criteriaResultsobject

Pass or fail for each success criterion. Keys are the criterion text in list order. Values are Pass or Fail.

Example response

{
  "batchId": "batch_s0OJu2JWR8R45Fai",
  "workspaceId": "org_V6eZ2zg8ziDx5pft",
  "agent": {
    "name": "New AI Agent",
    "agentId": "agent_D5D0p7TUs66TTAEAx",
    "status": "Live"
  },
  "testCase": {
    "testCaseId": "tc_d17T6uReChpyfFeP",
    "label": "Angry Customer - Cancellation Flow",
    "agent": {
      "name": "New AI Agent",
      "agentId": "agent_D5D0p7TUs66TTAEAx",
      "status": "Live"
    },
    "workspaceId": "org_V6eZ2zg8ziDx5pft",
    "llmModel": "gpt-5.6-luna",
    "mockData": [
      {
        "variableName": "customer_name",
        "value": "John Doe"
      },
      {
        "variableName": "account_status",
        "value": "active"
      }
    ],
    "mockToolData": [
      {
        "toolAlias": "get_order",
        "mockToolDataId": "mock_dpKjqjKnY3z6gABF",
        "name": "Success - Empty List",
        "statusCode": 200
      }
    ],
    "userPrompt": "You are an angry customer who wants to cancel your subscription.",
    "attempt": 5,
    "successCriteria": [
      "Agent was able to successfully look up the order.",
      "Agent was able to successfully close the call."
    ]
  },
  "jobId": "job_ksUu5yRHGTLLrLeM",
  "chatId": "chat_IpELinkFvINQ1212",
  "createdDate": "2026-03-26T10:52:45.565905Z",
  "completedDate": "2026-03-26T10:54:45.565905Z",
  "isSuccessful": true,
  "remarks": "The call was not closed. The agent stopped after confirming the refund.",
  "criteriaResults": {
    "Agent was able to successfully look up the order.": "Pass",
    "Agent was able to successfully close the call.": "Fail"
  },
  "conversation": [
    {
      "role": "user",
      "content": "I want to cancel my subscription immediately."
    }
  ]
}

Changes

    • breaking

      the / response's property type changed from string to array for status

    • info

      added the optional property to the response with the status

    • info

      added the optional property / to the response with the status