Evals

Create an Evaluator

Create a new evaluator in the workspace.

post/v2/evaluators

Request body

Example request

{
  "path": "Default Project",
  "project_id": "01JMDPA3QW5C1V0NJ1PW34T4E5"
}

Response

Successfully created an evaluator

Changes

Changed in 176 of the 251 revisions of this API.2512456

Aug 28, 20269642bb8e4f83315See the full diff
- ▲
  the request's body type/format changed from object/ to /
  request-body-type-changed
- ▲
  added EvaluatorResponseLlm EvaluatorResponseJsonSchema EvaluatorResponseHttp EvaluatorResponsePython EvaluatorResponseFunction EvaluatorResponseRagas EvaluatorResponseTypescript to the response body oneOf list for the response status 200
  response-body-one-of-added
- ▲
  the response's body type/format changed from object/ to / for status 200
  response-body-type-changed
- ●
  removed the optional property document from the response with the 200 status
  response-optional-property-removed
- ○
  request body became optional
  request-body-became-optional
- ○
  added subschema #1 subschema #2: Python to the request body oneOf list
  request-body-one-of-added
- ○
  added response discriminator for the response status 200
  response-body-discriminator-added
- ○
  added the non-success response with the status 403
  response-non-success-status-added
- ○
  added the non-success response with the status 404
  response-non-success-status-added
This revision also has 39 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Aug 27, 2026a38e9ab5977145See the full diff
- ▲
  request body became required
  request-body-became-required
- ▲
  removed subschema #1 subschema #2: Python from the request body oneOf list
  request-body-one-of-removed
- ▲
  the request's body type/format changed from / to object/
  request-body-type-changed
- ▲
  the response's body type/format changed from / to object/ for status 200
  response-body-type-changed
- ○
  removed response discriminator for the response status 200
  response-body-discriminator-removed
- ○
  removed EvaluatorResponseLlm EvaluatorResponseJsonSchema EvaluatorResponseHttp EvaluatorResponsePython EvaluatorResponseFunction EvaluatorResponseRagas EvaluatorResponseTypescript from the response body oneOf list for the response status 200
  response-body-one-of-removed
- ○
  removed the non-success response with the status 403
  response-non-success-status-removed
- ○
  removed the non-success response with the status 404
  response-non-success-status-removed
- ○
  added the optional property document to the response with the 200 status
  response-optional-property-added
This revision also has 9 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Aug 26, 2026d5a398a9e78d14See the full diff
- ○
  the created response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:26:44.323Z to 2026-08-26T20:33:32.017Z for the status 200
  response-property-default-value-changed
This revision also has 16 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Aug 26, 20261f8d6c19ffa214See the full diff
- ○
  the created response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T13:17:19.079Z to 2026-08-26T13:26:44.323Z for the status 200
  response-property-default-value-changed
This revision also has 1 change that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Aug 26, 202634cb457678d214See the full diff
- ○
  the created response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T11:10:54.428Z to 2026-08-26T13:17:19.079Z for the status 200
  response-property-default-value-changed
This revision also has 16 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Aug 26, 202632cce7a5d00714See the full diff
- ○
  the created response's property default value changed from 2026-08-26T09:46:51.830Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T09:46:51.830Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T09:46:51.830Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T09:46:51.830Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T09:46:51.830Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T09:46:51.830Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T09:46:51.830Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T09:46:51.831Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T09:46:51.831Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T09:46:51.831Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T09:46:51.831Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T09:46:51.831Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T09:46:51.831Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T09:46:51.831Z to 2026-08-26T11:10:54.428Z for the status 200
  response-property-default-value-changed
Aug 26, 202637cda3ee179b14See the full diff
- ○
  the created response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.830Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.830Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.830Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.830Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.830Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.830Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.830Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.831Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.831Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.831Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.831Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.831Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.831Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-26T07:29:37.805Z to 2026-08-26T09:46:51.831Z for the status 200
  response-property-default-value-changed
Aug 26, 20262e6a40acc9a514See the full diff
- ○
  the created response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T20:21:51.581Z to 2026-08-26T07:29:37.805Z for the status 200
  response-property-default-value-changed
Aug 25, 2026809833e6e71d14See the full diff
- ○
  the created response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T14:44:12.908Z to 2026-08-25T20:21:51.581Z for the status 200
  response-property-default-value-changed
This revision also has 3 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog
Aug 25, 20266df96c9d628e14See the full diff
- ○
  the created response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the created response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed
- ○
  the updated response's property default value changed from 2026-08-25T13:28:34.194Z to 2026-08-25T14:44:12.908Z for the status 200
  response-property-default-value-changed

Of the 251 revisions, 71 have no diff computed.

Full history (176 revisions)