Function Accuracy

Get a model comparison

Get a comparison's metrics.

Returns each entry's metric bundle (aggregate + per-field accuracy, latency, dataset baseline) and its lift against the baseline entry.

Every entry is re-scored on each read, so the parameters below decide the answer and none of them had to be chosen before the run started. Re-reading with different settings costs nothing — no model calls are repeated.

Structure — how array elements pair up:

  • orderMatching: score array elements in order instead of as sets

Strictness — how close two values must be to count as equal:

  • matchMode: strict (default) | normalized | fuzzy

matchMode is the whole of strictness. There are no separate thresholds to tune: normalized already compares numbers numerically and dates by calendar value rather than by spelling, and fuzzy adds a fixed similarity pass over free text.

get/v3/model-comparisons/{comparisonID}

Path parameters

comparisonIDstring required

The comparisonID returned by POST /v3/model-comparisons.

Query parameters

matchModestring

strict (default), normalized, or fuzzy. Any other value is a 400 — an unrecognized mode is rejected rather than scored at some other strictness.

orderMatchingboolean

Score array elements in order instead of as sets.

includeRowResultsboolean

Include per-row, per-field comparison detail (rowResults) on each entry, scored under the same settings as the metrics. Powers mislabel detection. Off by default — it can be large.

Response

The request has succeeded.

comparisonIDstring required
namestring
status'pending' | 'running' | 'complete' | 'partial' | 'cancelled' | 'error' required

Rolled-up status of a comparison, derived from its entries' scoring runs.

Changes