Sign in
custom-metrics

Preview Custom Metric

Evaluate a draft metric on ~5 recent logs without persisting results.

post/api/v1/custom-metrics/preview

Request body

promptstring required
response_type'pass_fail' | 'yes_no' | 'numeric_score' | 'categorical' | 'text' | 'json' required
configobject
modelstring nullable
linked_agent_idsstring[]
allow_naboolean

Response

Successful Response

logs_evaluatedinteger required

Changes

Changed in 1 of the 28 revisions of this API.2

  • d65b8fefae342See the full diff
    • ○

      added the optional property // to the response with the status

      response-optional-property-added

    • ○

      added the optional property // to the response with the status

      response-optional-property-added

    This revision also has 8 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

Of the 28 revisions, 1 has no diff computed.