WAwandb
Eval Results

Eval Results Query

Read grouped evaluation result rows for one or more evaluations.

post/v2/{entity}/{project}/eval_results/query

Request

  • Base URL
    https://api.training.wandb.ai
  • URL
    https://api.training.wandb.ai/v2/{entity}/{project}/eval_results/query
  • Auth
    none required

Path parameters

entitystring required
projectstring required

Request body

evaluation_call_idsstring[] nullable

Evaluation root call IDs to include.

evaluation_run_idsstring[] nullable

Alias for evaluation call IDs from the Evaluation Runs API.

require_intersectionboolean

When true, only include rows present in all requested evaluations.

include_raw_data_rowsboolean

When true, populate raw_data_row on each result row. Inline rows are returned as their dict value; dataset-referenced rows are returned as the ref string unless resolve_row_refs is also true.

resolve_row_refsboolean

When true (requires include_raw_data_rows=True), resolve dataset-row reference strings to actual row data via a table lookup. When false, dataset-row refs are returned as-is.

include_rowsboolean

When true, include grouped row/trial data in rows and compute total_rows for the requested row-level view.

include_summaryboolean

When true, include aggregated scorer/evaluation summary data in summary.

summary_require_intersectionboolean nullable

Optional intersection behavior for the summary section. When null, the value of require_intersection is used.

include_predict_and_score_childrenboolean

When true (default), fetch child calls (predict/score) of each predict_and_score call to populate predict_call_id, scorer_call_ids, and more precise latency/token data. When false, these fields are derived from the predict_and_score call itself (predict_call_id and scorer_call_ids will be null/empty).

include_costsboolean

When true, enrich the predict-and-score child calls with cost so the summary can report predict-only predict_total_cost. Opt-in: other callers skip the cost computation.

filter_logic_operator'and' | 'or'

How to combine filters across evaluations: 'and' (Match All - row must match in ALL evals) or 'or' (Match Any - row must match in ANY eval). Defaults to 'or' (Match Any).

limitinteger nullable

Optional row-level page size applied after grouping and intersection.

offsetinteger

Optional row-level page offset applied after grouping and intersection.

Response

Successful Response

total_rowsinteger required
warningsstring[]

Non-fatal warnings (e.g. failed to resolve dataset row refs).

Changes

No recorded changes to this operation across all 1 revision of this API.