TRtraceloop
evaluators

Execute agent-goal-accuracy evaluator

Changed on

Evaluate agent goal accuracy

Request Body:

  • input.question (string, required): The original question or goal
  • input.completion (string, required): The agent's completion/response
  • input.reference (string, required): The expected reference answer
post/v2/evaluators/agent-goal-accuracy/execute

Request

Request body

Example request

{
  "input": {
    "completion": "I have booked your flight from New York to Los Angeles departing Monday at 9am.",
    "question": "Book a flight from NYC to LA for next Monday",
    "reference": "Flight booked: NYC to LA, Monday departure"
  }
}

Response

OK

accuracy_scorenumber

Example response

{
  "accuracy_score": 0.88
}

Changes