Function Accuracy

Get Score Run

Get the status and per-pair results of a score run.

The comparison happens here, not in the run: the function's output is compared against the expected value on every read, under the configuration supplied below. Re-reading the same run with different settings returns different metrics and costs nothing — no model calls are repeated.

Comparison is exact and takes no configuration: a value matches the expected one or it is a miss. It is still redone on every read, so the numbers reflect the stored data as it is now.

Returns aggregate once status reaches completed or error. perPair is populated incrementally — each pair's fieldResults appears as its underlying function call terminates.

get/v3/eval/score/{scoreRunID}

Path parameters

scoreRunIDstring required

The scoreRunID returned by POST /v3/eval/score.

Response

The request has succeeded.

scoreRunIDstring required
status'pending' | 'initializing' | 'running' | 'completed' | 'error' | 'cancelled' required

Status values for an eval-score run.

functionNamestring required
functionVersionNuminteger required

Changes