TRtrainloop
public-api

Public Upsert Eval Group

Changed on

Create or update an eval group — idempotent upsert by slug.

post/v1/eval-groups

Request

  • Base URL
    https://api.trainloop.ai (the document declares no server; this is the origin it was published from)
  • Auth
    none declared

Headers

authorizationstring nullable

Request body

slugstring required
display_namestring required
score_format'percent' | 'decimal'

How the viewer renders scores: "percent" (73.5%) or "decimal" (0.735, for C-index/AUC). Omit it to keep an existing group's format; a new group takes "percent".

score_aggregation'mean' | 'max'

How member tasks roll up into the group score: "mean" (average) or "max" (best task). Omit it to keep an existing group's rollup; a new group takes "mean".

baselinenumber nullable

Optional random/chance baseline in the group's own units (0.5 for C-index, 0.25 for a 4-class task). It must be finite and has no upper bound, like every other score here. Omit it to keep an existing group's baseline, or send null to clear it.

sourcestring

Provenance of the group definition, e.g. "github:<org>/<repo>" when kept in sync from a customer repo. Empty = leave the stored value unchanged.

sync_enabledboolean nullable

Whether the nightly benchmark inventory may touch this group. None = leave the stored value unchanged (new groups default true).

Response

Successful Response

idstring uuid required
team_idstring uuid required
slugstring required
display_namestring required
created_atstring required
updated_atstring required

Changes