TRtrainloop
public-api

Public List Eval Groups

Changed on

List the team's eval groups (slug + display name).

get/v1/eval-groups

Request

  • Base URL
    https://api.trainloop.ai (the document declares no server; this is the origin it was published from)
  • Auth
    none declared

Headers

authorizationstring nullable

Response

Successful Response

slugstring required
display_namestring required
score_format'percent' | 'decimal'

How the viewer renders scores: "percent" (73.5%) or "decimal" (0.735, for C-index/AUC). Omit it to keep an existing group's format; a new group takes "percent".

score_aggregation'mean' | 'max'

How member tasks roll up into the group score: "mean" (average) or "max" (best task). Omit it to keep an existing group's rollup; a new group takes "mean".

baselinenumber nullable

Optional random/chance baseline in the group's own units (0.5 for C-index, 0.25 for a 4-class task). It must be finite and has no upper bound, like every other score here. Omit it to keep an existing group's baseline, or send null to clear it.

sourcestring

Provenance of the group definition, e.g. "github:<org>/<repo>" when kept in sync from a customer repo. Empty = leave the stored value unchanged.

sync_enabledboolean nullable

Whether the nightly benchmark inventory may touch this group. None = leave the stored value unchanged (new groups default true).

display_name_lockedboolean

True when a person renamed the group. An upsert keeps a locked display name.

Changes

  • 0d3ac76175e8Revision changes
    • breaking

      the / response property's maxLength was increased from 255 to 1024 for the response status

    • info

      added the optional property / to the response with the status