---
title: "Add evaluation configurations"
method: POST
path: "/simulate/run-tests/{run_test_id}/eval-configs/"
tags: ["Run Tests - Eval Configs"]
---

# Add evaluation configurations

`POST /simulate/run-tests/{run_test_id}/eval-configs/`

## Request

- Base URL: `http://localhost:8000`
- URL: `http://localhost:8000/simulate/run-tests/{run_test_id}/eval-configs/`
- Auth: one of:
  - API key in header `X-Api-Key`
  - API key in header `X-Secret-Key`

Adds evaluation configurations to a test run. Returns 201 with the created configs.

## Request body

- AddEvalConfigsRequest
  - `evaluations_config` EvalConfigDefinition[], required: Array of evaluation configuration objects to add. At least one required.
    - `template_id` string, uuid, required: UUID of the evaluation template to use.
    - `name` string: Name for this evaluation configuration. Defaults to 'Eval-<template_id>' if omitted.
    - `config` object: Template-specific configuration parameters.
    - `mapping` object: Maps test execution data fields to the evaluation template's expected inputs.
    - `filters` object[]: Canonical filter list to restrict which test results are evaluated.
      - `column_id` string, required: Column or attribute id to filter on.
      - `property_id` string: Optional stable namespaced Property Registry identity.
      - `display_name` string: Optional UI label for chips and saved views.
      - `source` string: Optional source surface for mixed-source filters, for example traces, datasets, or simulation.
      - `output_type` string: Optional metric output type metadata used by eval and annotation filters.
      - `filter_config` object, required
        - `filter_type` string, required: Canonical field type, for example text, number, boolean, datetime, categorical, thumbs, annotator, array, or map. Legacy json is value-sensitive for SPAN_ATTRIBUTE filters: list values become array and object values become map.
        - `filter_op` string, required: Canonical operator from api_contracts/filter_contract.json, for example equals, not_equals, in, not_in, between, not_between, is_null, or is_not_null.
        - `filter_value` unknown
        - `col_type` string: Column family such as SYSTEM_METRIC, SPAN_ATTRIBUTE, EVAL_METRIC, ANNOTATION, or NORMAL.
        - `attribute_value_types` string[]: Optional storage-family provenance aligned one-for-one with filter_value for mixed SPAN_ATTRIBUTE in/not_in filters. Null entries retain filter_type semantics for manually entered values.
    - `error_localizer` boolean: Enables granular error localization on evaluation failures.
    - `model` string, nullable: Model to use for running this evaluation.
    - `kb_id` string, uuid, nullable: Knowledge base file to use for this evaluation.
    - `eval_group` string, uuid, nullable: Eval group that created this evaluation config.

## Response `201`

Created

- AddEvalConfigsResponse
  - `message` string, required
  - `created_eval_configs` EvalConfigResponse[], required
    - `id` string, uuid
    - `name` string, nullable
    - `config` object, nullable
    - `mapping` object, nullable
    - `filters` object, nullable
    - `error_localizer` boolean
    - `model` string, nullable
    - `status` 'NotStarted' | 'Queued' | 'Running' | 'Completed' | 'Editing' | 'Inactive' | 'Failed' | 'PartialRun' | 'ExperimentEvaluation' | 'Uploading' | 'PartialExtracted' | 'Processing' | 'Deleting' | 'PartialCompleted' | 'OptimizationEvaluation' | 'Error' | 'Cancelled'
    - `eval_group` string
    - `template_id` string, uuid
    - `eval_type` string
    - `regradable` boolean
    - `editable` boolean
  - `run_test_id` string, uuid, required
  - `warnings` string[]: Non-fatal issues encountered while processing individual configs.

## Other responses

- `400`: Bad Request
- `401`: Unauthorized
- `404`: Not Found
- `500`: Internal Server Error
- `default`: Default error response

---

[API](https://skmtc.dev/futureagi/apis/future-agi-management-api.md) · [All operations](https://skmtc.dev/futureagi/apis/future-agi-management-api/llms.txt) · [OpenAPI document](https://skmtc.dev/futureagi/apis/future-agi-management-api/revisions/c8684118e142?raw)