LLM Judges

Judge Batch

Run an LLM judge across N uncertain matchups on this ranking.

Picks matchups using the existing matchmaking service (uncertainty-weighted) so the judge spends its budget on the most-informative comparisons.

post/api/v1/judges/batch

Request

  • Base URL: https://app.aimrank.io (the document declares no server; this is the origin it was published from)
  • URL: https://app.aimrank.io/api/v1/judges/batch
  • Auth: none declared

Request body

ranking_idstring required
judge_idstring
n_matchupsinteger
criterionstring nullable
randomize_positionboolean
max_tokensinteger
thinkingboolean
apply_constitutionboolean

Response

Successful Response

unknown required

Changes

No recorded changes to this operation across all 1 revision of this API.