TRtraceloop
evaluators

Execute intent-change evaluator

Changed on

Detect changes in user intent between prompts and completions

Request Body:

  • input.prompts (string, required): JSON array of prompts in the conversation
  • input.completions (string, required): JSON array of completions in the conversation
post/v2/evaluators/intent-change/execute

Request

Request body

Example request

{
  "input": {
    "completions": "[\"Sure, I can help with hotel booking\", \"No problem, let me search for flights\"]",
    "prompts": "[\"I want to book a hotel\", \"Actually, I need a flight instead\"]"
  }
}

Response

OK

reasonstring
scoreinteger
successboolean

Example response

{
  "reason": "User intent remained consistent throughout the conversation",
  "score": 1,
  "success": true
}

Changes