Sign in
Eval runs

Persist advisory case-run evaluations

Persist advisory case-run evaluations. Uses the SDK reporting transport and the same tenant/project authorization as eval ingestion. Unsupported capabilities remain absent.

post/projects/{projectId}/eval-ingest/runs/evaluations

Path parameters

projectIdstring required

Project id, or the literal default for the key org's Default project.

Headers

x-mcpjam-eval-vocabulary'1' | '2'

Which vocabulary this request and its response speak. Absent means 1, which is byte-for-byte today's contract: the same request fields, the same refusals, the same response projection. 2 is the canonical vocabulary. Any other value is a 400 with code: "VALIDATION_ERROR".

Today it decides one thing: the spelling of an evaluator's policy role. Vocabulary 1 accepts and returns gating; vocabulary 2 accepts both spellings and returns the canonical required. Sending required without the header is a 400, deliberately — vocabulary 1 is not widened to meet vocabulary 2 half way, because a boundary that accepts a spelling it does not announce is one two implementations can disagree about.

A response that varies by vocabulary sends Vary: x-mcpjam-eval-vocabulary.

Request body

runIdstring required
externalRunIdstring required
evaluationsobject[] required

Response

The backend's response, passed through.

okboolean required
runIdstring required
persistedCasesinteger required

Changes

Changed in 2 of the 122 revisions of this API.2