evaluators

Run an evaluator

Run an evaluator against raw unified inputs. The evaluator ID may include a version suffix such as evl_abc123:2 to run a specific version.

post/api/evaluators/{evaluator_id}/run/

Path parameters

evaluator_idstring required

Evaluator ID. To run a specific version, pass an ID with a version suffix where supported, for example evl_abc123:2.

Headers

Authorizationstring required

Use your Respan API key for Respan API authentication. Enter only the Respan API key value; clients send Authorization: Bearer <RESPAN_API_KEY>. For /api/responses, provider credentials such as Perplexity, OpenAI, or Azure OpenAI go in Settings -> Providers or respan_params.credential_override in the request body, not in this authentication field.

Request body

generation_method'auto' | 'llm' | 'code'

Optional method override for evaluators that support multiple execution modes.

evaluation_idstring

Legacy evaluator ID field. Prefer the path parameter or evaluator_id.

evaluator_idstring

Optional evaluator ID override. Supports version suffixes such as evl_abc123:2.

Response

Evaluation result.

idstring

Score/result ID.

created_atstring date-time
typestring
environmentstring
numerical_valuenumber double nullable
string_valuestring nullable
boolean_valueboolean nullable
categorical_valuestring[] nullable
json_valuestring nullable
is_passedboolean nullable
costnumber double nullable
evaluator_idstring
evaluator_slugstring
scorerstring nullable
log_idstring nullable
prompt_idstring nullable
prompt_version_numberinteger nullable
dataset_idstring nullable
automation_idstring nullable
statusstring nullable
error_messagestring nullable

Changes