Sign in
evaluators

Execute intent-change evaluator

Detect changes in user intent between prompts and completions

Request Body:

  • input.prompts (string, required): JSON array of prompts in the conversation
  • input.completions (string, required): JSON array of completions in the conversation
  • config.model (string, optional): Model to use for evaluation (default: gpt-4o)
post/v2/evaluators/execute/intent-change

Request body

Example request

{
  "config": {
    "model": "gpt-4o"
  },
  "input": {
    "completions": "[\"Sure, I can help with hotel booking\", \"No problem, let me search for flights\"]",
    "prompts": "[\"I want to book a hotel\", \"Actually, I need a flight instead\"]"
  }
}

Response

OK

passboolean
reasonstring
scoreinteger

Example response

{
  "pass": true,
  "reason": "User intent remained consistent throughout the conversation",
  "score": 1
}

Changes