evaluations

Rerun With Skill

Re-run an evaluation with a different skill. If skill_id is omitted the source skill is optimized first. Returns the skill_id immediately while processing continues in the background. Poll the evaluation run by ID to check completion status.

post/v1/evaluations/rerun

Request

  • Base URL: https://api.vlm.run (the document declares no server; this is the origin it was published from)
  • URL: https://api.vlm.run/v1/evaluations/rerun
  • Auth: HTTP bearer

Request body

evaluation_idstring required

Existing evaluation run ID to rerun against

skill_idstring nullable

New skill ID to evaluate. If omitted, the source skill is optimized first.

evaluatorsstring[] nullable

Evaluators to run on the re-processed responses. When omitted, inherited from the original run's stored config (falls back to ['field_accuracy'] for legacy runs without config).

infer_correctionsboolean nullable

Use LLM to produce corrected JSON from notes-only feedback. When omitted, inherited from the original run's stored config (defaults to True for legacy runs).

n_samplesinteger

Number of response/correction pairs to sample when auto-optimizing.

fieldsstring[] nullable

Restrict evaluation to these field names (top-level keys or dotted leaf-path prefixes, e.g. ['name', 'address', 'items']). When omitted, inherited from the original run's stored config (defaults to all fields for legacy runs).

skip_null_expectedboolean nullable

When true, fields where the ground-truth (expected) value is null are excluded from evaluation. When omitted, inherited from the original run's stored config (defaults to True for legacy runs).

modelstring nullable

Model to use when re-running inference (e.g. 'vlmrun-orion-2:pro'). When omitted, uses the model from the original requests. If results for this model already exist on the target skill, inference is skipped and the evaluation runs directly on those existing results.

Response

Successful Response

evaluation_idstring required

ID of the new evaluation run

skill_idstring required

Skill ID being used for the rerun

statusstring

Status of the evaluation run; always 'running' on return. Poll by ID for 'completed' or 'failed'.

Changes

No recorded changes to this operation across all 2 revisions of this API.