Eval Jobs

Trigger an eval job run

Explicit datasetItemIds take precedence. Otherwise filterConfig replaces the saved defaultFilterConfig; when omitted, the saved filter applies before sampling and skipEvaluated. Use agentName to filter dataset items by agent name.

post/api/v1/eval-jobs/{id}/trigger

Request

  • Base URL: https://dev.noveum.ai
  • URL: https://dev.noveum.ai/api/v1/eval-jobs/{id}/trigger
  • Auth: API key in cookie apiKeyCookie and HTTP bearer

Path parameters

idstring required

Query parameters

organizationIdstring
organizationSlugstring
projectIdstring

Request body

datasetItemIdsstring[]
skipEvaluatedboolean
forceReevaluateboolean
useSamplingboolean

Response

Eval job run created and queued

idstring required
evalJobIdstring required
statusstring required
startTimeunknown required
endTimeunknown required
itemsProcessednumber required
itemsFailednumber required
errorunknown required
resultsunknown
tierunknown
parentRunIdunknown
samplingMetaunknown
createdAtstring required
updatedAtstring required

Changes

No recorded changes to this operation across all 1 revision of this API.