Benchmarks

Compare two benchmark runs

Returns both benchmark runs side by side together with the overall accuracy delta (run_a minus run_b). The delta is null when either run has not yet produced an overall accuracy score.

get/v1/quality/benchmarks/compare

Request

Base URL: https://api.talonic.com
URL: https://api.talonic.com/v1/quality/benchmarks/compare
Auth: HTTP bearer

Query parameters

run_astring uuid required

Example:a1b2c3d4-e5f6-7890-abcd-ef1234567890

ID of the first benchmark run.

run_bstring uuid required

Example:b2c3d4e5-f6a7-8901-bcde-f12345678901

ID of the second benchmark run to compare against.

Response

Both benchmark runs and their accuracy delta.

accuracy_deltanumber float nullable

Overall accuracy of run_a minus run_b, or null if either is unscored.

Example response

{
  "run_a": {
    "id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
    "dataset_id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
    "user_schema_id": "b2c3d4e5-f6a7-8901-bcde-f12345678901",
    "status": "completed",
    "compared_to_run_id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
    "created_at": "2026-04-25T14:30:00.000Z",
    "completed_at": "2026-04-25T14:30:00.000Z"
  },
  "run_b": {
    "id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
    "dataset_id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
    "user_schema_id": "b2c3d4e5-f6a7-8901-bcde-f12345678901",
    "status": "completed",
    "compared_to_run_id": "a1b2c3d4-e5f6-7890-abcd-ef1234567890",
    "created_at": "2026-04-25T14:30:00.000Z",
    "completed_at": "2026-04-25T14:30:00.000Z"
  }
}

Changes

No recorded changes to this operation across all 1 revision of this API.