evaluators
Execute context-relevance evaluator
Evaluate whether retrieved context contains sufficient information to answer the query
Request Body:
- input.query (string, required): The query/question to evaluate context relevance for
- input.context (string, required): The context to evaluate for relevance to the query
- config.model (string, optional): Model to use for evaluation (default: gpt-4o)
post/v2/evaluators/execute/context-relevance
Request body
Example request
{
"config": {
"model": "gpt-4o"
},
"input": {
"context": "Our store is open Monday to Friday from 9am to 6pm, and Saturday from 10am to 4pm. We are closed on Sundays.",
"query": "What are the business hours?"
}
}Response
OK
Example response
{
"relevance_score": 0.88
}