TRtrainloop
public-api

Public Upsert Eval Task

Changed on

Create or update an eval task in a group — idempotent upsert by slug.

post/v1/evals

Request

  • Base URL
    https://api.trainloop.ai (the document declares no server; this is the origin it was published from)
  • Auth
    none declared

Headers

authorizationstring nullable

Request body

slugstring required
display_namestring required
group_slugstring required
taskstring required

Task description shown on the task page

criteriaobject[]

Grading rubric entries ({id, question, rationale}), rendered as the task page's Verifiers card. Empty = leave the stored value unchanged, unless replace_enrichment is true.

seed_datastring

Verbatim mock/seed source blocks — the task's starting world state, rendered as a collapsible card. Empty = leave the stored value unchanged, unless replace_enrichment is true.

description_fingerprintstring nullable

sha256 of the source file the criteria and seed data were written from. Omit it or send null to keep the stored value, unless replace_enrichment is true.

replace_enrichmentboolean

Store criteria, seed_data and description_fingerprint exactly as sent, so an empty or null value clears the stored one. It is off by default, and then an empty value keeps what is stored.

Response

Successful Response

idstring uuid required
team_idstring uuid required
group_slugstring required
slugstring required
display_namestring required
taskstring required
created_atstring required
updated_atstring required

Changes