TRtraceloop
evaluators

Execute instruction-adherence evaluator

Changed on

Evaluate how well responses follow given instructions

Request Body:

  • input.instructions (string, required): The instructions that should be followed
  • input.response (string, required): The response to evaluate for instruction adherence
post/v2/evaluators/instruction-adherence/execute

Request

Request body

Example request

{
  "input": {
    "instructions": "Respond in exactly 3 bullet points and use formal language.",
    "response": "- First point about the topic\n- Second relevant consideration\n- Final concluding thought"
  }
}

Response

OK

instruction_adherence_scorenumber

Example response

{
  "instruction_adherence_score": 0.87
}

Changes