Evaluations

List eval runs

Returns an eval's runs, newest first

get/v1/projects/{project_id}/evals/{eval_id}/runs

Request

  • Base URL: https://api.naturali.ai
  • URL: https://api.naturali.ai/v1/projects/{project_id}/evals/{eval_id}/runs
  • Auth: one of:
    • HTTP bearer
    • OAuth 2 (authorization code, authorization URL https://api.naturali.ai/authorize, token URL https://api.naturali.ai/token, scopes: mcp:access)

Path parameters

eval_idstring required
Example:eval_V1StGXR8Z5jdHi6B

Eval ID

Query parameters

limitinteger

Results per page, 1 to 100 (default 50). Above 100 it is clamped; below 1 or not an integer it is 400.

offsetinteger

Results to skip. Negative or not an integer it is 400.

Response

List of eval runs

totalinteger required
limitinteger required
offsetinteger required

Example response

{
  "data": [
    {
      "id": "evrun_V1StGXR8Z5jdHi6B",
      "eval_id": "eval_V1StGXR8Z5jdHi6B",
      "agent_version": 3,
      "decider_versions": {
        "review": 2
      },
      "baseline_run_id": "evrun_V1StGXR8Z5jdHi6B",
      "trigger_id": "trg_V1StGXR8Z5jdHi6B",
      "aggregate_scores": {
        "pass_rate_interval": {
          "low": 0.63,
          "high": 0.84,
          "level": 0.95
        },
        "baseline": {
          "run_id": "evrun_V1StGXR8Z5jdHi6B",
          "p_value": 0.03,
          "grouping": {
            "group_by": "kind"
          }
        },
        "grouping": {
          "group_by": "kind"
        }
      },
      "metadata": {
        "author": "John",
        "revision": 2
      }
    }
  ]
}

Changes

No recorded changes to this operation across all 1 revision of this API.