evaluators

Execute agent-tool-error-detector evaluator

Detect errors or failures during tool execution

Request Body:

  • input.tool_input (string, required): JSON string of the tool input
  • input.tool_output (string, required): JSON string of the tool output
post/v2/evaluators/execute/agent-tool-error-detector

Request body

Example request

{
  "input": {
    "tool_input": "{\"action\": \"search\", \"query\": \"flights to Paris\"}",
    "tool_output": "{\"status\": \"success\", \"results\": [{\"flight\": \"AF123\", \"price\": 450}]}"
  }
}

Response

OK

reasonstring
resultstring

Example response

{
  "reason": "Tool executed successfully without errors",
  "result": "success"
}

Changes