---
title: "Create Evaluation"
method: POST
path: "/agents/{agent_id}/evaluate"
tags: ["/agents/{id}/evaluate"]
---

# Create Evaluation

`POST /agents/{agent_id}/evaluate`

Launch an `Evaluation` job which evaluates an `Agent` on a set of test questions and reference answers.

An `Evaluation` is an asynchronous operation. Users can select one or more metrics to assess the quality of generated answers. These metrics include `equivalence` and `groundedness`. `equivalence` evaluates if the Agent response is equivalent to the ground truth (model-driven binary classification). `groundedness` decomposes the Agent response into claims and then evaluates if the claims are grounded by the retrieved documents.

`Evaluation` data can be provided in one of two forms:

- A CSV `evalset_file` containing the columns `prompt` (i.e. questions) and `reference` (i.e. gold-answers).

- An `evalset_name` which refers to a `Dataset` created through the `/datasets/evaluate` API.

## Path parameters

- `agent_id` string, uuid, required — Agent ID of the agent to evaluate

## Response `200`

Successful Response

- LaunchEvaluationResponse — Response from Launch Evaluation request
  - `id` string, uuid, required — ID of the launched evaluation

## Other responses

- `422` — Validation Error

## Changes

- **2025-05-08** `17bdb8a33fb4` — 2 info
  - added the new optional request property `notes`
  - added the new optional request property `override_configuration`
- **2025-02-08** `d79ccb778953` — 1 breaking
  - request property `llm_model_id` list-of-types was narrowed by removing types `null` from media type `multipart/form-data`
- **2025-01-15** `4ed32c3243ce` — 1 warning, 1 info
  - removed the request property `model_name`
  - added the new optional request property `llm_model_id`
- **2025-01-14** `448bcb901d30` — 1 info
  - request body became optional
- **2025-01-14** `4dd01a1cc34b` — 1 info
  - endpoint added

[Change history](https://skmtc.dev/contextualai/apis/endpoints/changes/agents/:agent_id/evaluate/post.md)

---

[API](https://skmtc.dev/contextualai/apis/endpoints.md) · [All operations](https://skmtc.dev/contextualai/apis/endpoints/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/contextualai/endpoints/revisions/17bdb8a33fb4/schema)