Eval runs

Authenticate and record an eval start

Changed on

Called by official SDK, CLI and Vitest runners before executing an eval. Requires an organization API key or saved-login bearer. Records only start metadata, creates no dashboard run, and applies no debit or quota draw. Planned iterations are intent, not completed usage. Reuse the runStartId for retries of the same logical run; changed metadata with the same ID returns 409. Replay protection is retained for the lifetime of the owning scope. The gateway passes the backend status and receipt through unchanged.

post/projects/{projectId}/eval-ingest/start-run

Request

  • Base URL
    https://app.mcpjam.com/api/v1
  • URL
    https://app.mcpjam.com/api/v1/projects/{projectId}/eval-ingest/start-run
  • Auth
    HTTP bearer

Path parameters

projectIdstring required

Project id, or default to resolve the authenticated organization's Default project.

Request body

runStartIdstring uuid required
surface'sdk' | 'cli' | 'vitest' required
clientVersionstring required
providersstring[] required
plannedIterationsinteger required

Response

Authenticated start receipt. Identical retries return the same receipt.

oktrue required
runStartIdstring uuid required
organizationIdstring required
projectIdstring required

Changes