---
title: "Create a new eval job"
method: POST
path: "/api/v1/eval-jobs"
tags: ["Eval Jobs"]
---

# Create a new eval job

`POST /api/v1/eval-jobs`

## Request

- Base URL: `https://dev.noveum.ai`
- URL: `https://dev.noveum.ai/api/v1/eval-jobs`
- Auth: API key in cookie `apiKeyCookie` and HTTP bearer

Create a new eval job

## Query parameters

- `organizationId` string
- `organizationSlug` string
- `projectId` string

## Request body

- object
  - `name` string, required
  - `description` string
  - `datasetId` string, required
  - `datasetSlug` string, required
  - `datasetType` 'agent' | 'conversational' | 'rag' | 'g-eval' | 'accuracy'
  - `projectId` string
  - `scorerConfigs` object[]
    - `scorerId` string, required
    - `scorerType` string, required
    - `scorerName` string, required
    - `threshold` number
    - `instruction` string
    - `llmConfig` object
      - `provider` string
      - `modelName` string
      - `temperature` number
      - `providerId` string
  - `defaultFilterConfig` object
    - `dateFrom` string
    - `dateTo` string
    - `environment` string
    - `hasToolCalls` boolean
    - `hasRag` boolean
    - `exitStatus` string
    - `itemType` string
    - `scoreFilter` object
      - `scorerId` string, required
      - `operator` 'lt' | 'lte' | 'gt' | 'gte', required
      - `value` number, required
    - `scoreFilters` object[]
      - `scorerId` string, required
      - `operator` 'lt' | 'lte' | 'gt' | 'gte', required
      - `value` number, required
    - `scoreFilterCombinator` 'and' | 'or'
    - `hasEvalScores` boolean
    - `agentName` string
    - `search` string
    - `qualityScoreGte` number
    - `qualityScoreLte` number
    - `sourceTraceStatus` string
    - `serviceVersion` string
  - `evalPolicy` object
    - `version` number, required
    - `sampling` object, required
      - `percent` number, required
      - `boostShare` number
      - `adaptiveShare` number
      - `stratifyBy` string[]
      - `boosts` union[]
        - union
          - object
            - `type` string, required
          - object
            - `type` string, required
          - object
            - `type` string, required
            - `percentile` number
          - object
            - `type` string, required
            - `percentile` number
          - object
            - `type` string, required
            - `key` string, required
            - `op` 'eq' | 'neq' | 'contains' | 'gt' | 'lt', required
            - `value` union, required
              - …
      - `llmPrescreen` object
        - `enabled` boolean, required
    - `tiers` object[], required
      - `name` string, required
      - `scorerIds` string[], required
      - `escalateIf` object
        - `conditions` object[], required
          - `scorerId` string, required
          - `op` 'failed' | 'lt' | 'lte', required
          - `value` number
        - `combinator` 'or' | 'and'
        - `aggregation` 'any_turn' | 'avg'
  - `isEnabled` boolean
  - `isAdhoc` boolean
  - `targetItemId` string

## Response `200`

Success

- object

## Other responses

- `201`: Returns the created eval job
- `400`: Bad request
- `401`: Unauthorized
- `403`: Forbidden
- `404`: Not found
- `409`: Conflict
- `422`: Unprocessable entity
- `500`: Internal server error

---

[API](https://skmtc.dev/noveum/apis/noveum-api.md) · [All operations](https://skmtc.dev/noveum/apis/noveum-api/llms.txt) · [OpenAPI document](https://skmtc.dev/noveum/apis/noveum-api/revisions/1745e27f38d0?raw)