observability

Validate Eval

Dry-run validate a custom eval definition without storing it. Use when building an eval in a form and you want author-time feedback before saving: it runs the same structural checks as creating one (input-schema shape, subject-to-input-field integrity, per-grader config) and returns valid plus a flat list of path + message errors. Never writes anything.

post/api/platform/v1/evals/validate

Request

  • Base URL: https://docs.amdahl.ai
  • URL: https://docs.amdahl.ai/api/platform/v1/evals/validate
  • Auth: one of:
    • API key in header X-API-Key
    • HTTP bearer

Request body

slugstring required
namestring required
descriptionstring
versionstring
input_schemaobject
casesobject[] required
reliabilityobject

Required for any grader that reports a MAGNITUDE (judge / evidence_judge / improvement_loop): the measured flip rate and the floor a reported lift must clear. Validation refuses without it, so declare it rather than discovering the refusal.

Response

OK

Changes

No recorded changes to this operation across all 1 revision of this API.