/
TR
traceloop
Search skmtc…
⌘K
Docs
Sign in
Docs
History
Schema
Generate
Filter operations
auto-monitor-setups
5
evaluators
38
post
/v2/evaluators
Create a custom LLM-as-a-judge evaluator
post
/v2/evaluators/agent-efficiency/execute
Execute agent-efficiency evaluator
post
/v2/evaluators/agent-flow-quality/execute
Execute agent-flow-quality evaluator
post
/v2/evaluators/agent-goal-accuracy/execute
Execute agent-goal-accuracy evaluator
post
/v2/evaluators/agent-goal-completeness/execute
Execute agent-goal-completeness evaluator
post
/v2/evaluators/agent-tool-error-detector/execute
Execute agent-tool-error-detector evaluator
post
/v2/evaluators/agent-tool-selection-quality/execute
Execute agent-tool-selection-quality evaluator
post
/v2/evaluators/agent-tool-trajectory/execute
Execute agent-tool-trajectory evaluator
post
/v2/evaluators/action-advancement/execute
Execute action-advancement evaluator
post
/v2/evaluators/answer-completeness/execute
Execute answer-completeness evaluator
post
/v2/evaluators/answer-correctness/execute
Execute answer-correctness evaluator
post
/v2/evaluators/answer-relevancy/execute
Execute answer-relevancy evaluator
post
/v2/evaluators/char-count/execute
Execute char-count evaluator
post
/v2/evaluators/char-count-ratio/execute
Execute char-count-ratio evaluator
post
/v2/evaluators/context-relevance/execute
Execute context-relevance evaluator
post
/v2/evaluators/conversation-quality/execute
Execute conversation-quality evaluator
post
/v2/evaluators/faithfulness/execute
Execute faithfulness evaluator
post
/v2/evaluators/html-comparison/execute
Execute html-comparison evaluator
post
/v2/evaluators/instruction-adherence/execute
Execute instruction-adherence evaluator
post
/v2/evaluators/intent-change/execute
Execute intent-change evaluator
post
/v2/evaluators/json-validator/execute
Execute json-validator evaluator
post
/v2/evaluators/perplexity/execute
Execute perplexity evaluator
post
/v2/evaluators/pii-detector/execute
Execute pii-detector evaluator
post
/v2/evaluators/placeholder-regex/execute
Execute placeholder-regex evaluator
post
/v2/evaluators/profanity-detector/execute
Execute profanity-detector evaluator
post
/v2/evaluators/prompt-injection/execute
Execute prompt-injection evaluator
post
/v2/evaluators/prompt-perplexity/execute
Execute prompt-perplexity evaluator
post
/v2/evaluators/regex-validator/execute
Execute regex-validator evaluator
post
/v2/evaluators/secrets-detector/execute
Execute secrets-detector evaluator
post
/v2/evaluators/semantic-similarity/execute
Execute semantic-similarity evaluator
post
/v2/evaluators/sexism-detector/execute
Execute sexism-detector evaluator
post
/v2/evaluators/sql-validator/execute
Execute sql-validator evaluator
post
/v2/evaluators/tone-detection/execute
Execute tone-detection evaluator
post
/v2/evaluators/topic-adherence/execute
Execute topic-adherence evaluator
post
/v2/evaluators/toxicity-detector/execute
Execute toxicity-detector evaluator
post
/v2/evaluators/uncertainty-detector/execute
Execute uncertainty-detector evaluator
post
/v2/evaluators/word-count/execute
Execute word-count evaluator
post
/v2/evaluators/word-count-ratio/execute
Execute word-count-ratio evaluator
metrics
2
organizations
1
evaluators
Copy
Copy Markdown
Copy Markdown
Copying…
Copied
Copy failed
Changes to Create a custom LLM-as-a-judge evaluator
post
/v2/evaluators
Apr 12, 2026
bd3e46b75d87
Revision changes
info
endpoint added
Jan 1, 2026
aef6c851927f
Revision changes
breaking
api path removed without deprecation