CAcaveman

GET /projects/{projectId}/eval-scenarios/{datasetId}/versions/{version}/runs/compare

GET /api/v1/projects/{projectId}/eval-scenarios/{datasetId}/versions/{version}/runs/compare on the Caveman Cloud control plane. Requires the payload:read scope. Exposed to autonomous agents as the compare_scenarios action of the caveman_evals tool (read access). Versioned datasets, reusable evaluators, workbench documents, strict suites, and evaluation evidence.

get/projects/{projectId}/eval-scenarios/{datasetId}/versions/{version}/runs/compare

Request

  • Base URL
    https://api.caveman.so/api/v1
  • URL
    https://api.caveman.so/api/v1/projects/{projectId}/eval-scenarios/{datasetId}/versions/{version}/runs/compare
  • Auth
    • OAuth 2
      Authorization code: /api/v1/oauth/authorize
      Token URL: /api/v1/oauth/token scopes: payload:read
    • or HTTP bearer
    • or API key in cookie cave_access
    • or API key in cookie __Secure-cave_identity.session_token

Query parameters

baseline_run_idstring uuid required
candidate_run_idstring uuid required

Response

Successful response. Exact status depends on synchronous or durable delivery outcome.

Changes

No recorded changes to this operation across all 1 revision of this API.