Eval Jobs

Evaluate a single dataset item, auto-triggering if a configured eval job exists

Evaluate a single dataset item, auto-triggering if a configured eval job exists

post/api/v1/eval-jobs/evaluate-item

Request

  • Base URL: https://dev.noveum.ai
  • URL: https://dev.noveum.ai/api/v1/eval-jobs/evaluate-item
  • Auth: API key in cookie apiKeyCookie and HTTP bearer

Query parameters

organizationIdstring
organizationSlugstring
projectIdstring

Request body

datasetIdstring required
datasetSlugstring required
datasetType'agent' | 'conversational' | 'rag' | 'g-eval' | 'accuracy'
targetItemIdstring required

Response

Returns evaluation trigger result: either auto-triggered with job IDs or requires manual scorer selection

OR

Changes

No recorded changes to this operation across all 1 revision of this API.