Sign in
custom-metrics

Preview Custom Metric

Evaluate a draft metric on ~5 recent logs without persisting results.

post/api/v1/custom-metrics/preview

Request body

promptstring required
response_type'pass_fail' | 'yes_no' | 'numeric_score' | 'categorical' | 'text' | 'json' required
configobject
modelstring nullable
linked_agent_idsstring[]
allow_naboolean

Response

Successful Response

logs_evaluatedinteger required

Changes