Sign in
Custom Metrics

Get Custom Metric

Get a specific custom metric by ID.

get/v1/custom-metric/{metric_id}

Path parameters

metric_idstring uuid required

Headers

X-Organization-Idstring
X-API-Keystring required

API key required to authenticate requests.

Response

Successful Response

idstring required

Unique identifier for the custom metric

bluejay_as_code_idstring nullable

Stable code-addressable identifier (same as id for custom metrics)

namestring required

Name of the custom metric

promptstring nullable

LLM-judge system prompt for this metric (null for non-judge types)

descriptionstring nullable

Deprecated: same value as prompt

summarystring nullable

Short plain-English description of the metric (LLM-generated)

metric_typestring

Specific metric kind

eval_methodstring

Evaluation category (llm_judge|statistical|ml_model|deterministic)

settingsobject

Type-specific config

eval_segmentstring

Which side of the conversation is evaluated (agent|user|all)

scopestring

Which pipeline runs this metric (observability|simulations|all)

response_type'pass_fail' | 'yes_no' | 'qualitative' | 'quantitative' | 'json' | 'enum' | 'int' | 'float' | 'boolean' | 'tool_call' required

Enum representing the possible response types for custom metrics.

agent_idsinteger[]

List of agent IDs this metric belongs to

min_valuenumber nullable

Minimum value for quantitative metrics

max_valuenumber nullable

Maximum value for quantitative metrics

categorystring nullable

Category for organizing metrics

tagsstring[] nullable

Tags for categorizing the metric

scoring_guidancestring nullable

Guidance on how to score this metric

created_atstring date-time required

When this metric was created

updated_atstring date-time nullable

When this metric was last updated

updated_bystring nullable

User who last updated this metric

created_bystring nullable

User who created this metric

eval_modality'AUDIO' | 'TEXT' | 'AUTO'

Enum representing the evaluation route of a call.

modelstring nullable

Model to use for text evaluation of the metric

audio_modelstring nullable

Model to use for audio evaluation of the metric

temperaturenumber nullable

Temperature for evaluating the metric

enum_optionsstring[] nullable

Options for enum metrics

tool_namesstring[] nullable

Deprecated: mirror of settings.tool_names for tool_call metrics

json_schemaobject nullable

JSON Schema describing the object the judge must return (json metrics only)

allow_not_applicableboolean

Whether this metric allows 'not applicable' responses.

eval_modality_auto_selectedboolean

Deprecated: always false (column removed).

template_idstring nullable

Library template this metric was created from

Changes

Changed in 3 of the 22 revisions of this API.2515

  • aa501502e1fc1See the full diff
    • ○

      added the new optional header request parameter X-Organization-Id

      new-optional-request-parameter

  • 4309a961859b3See the full diff
    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

  • 44d183272ce12511See the full diff
    • ▲

      the response property became optional for the status

      response-property-became-optional

    • ▲

      response property description list-of-types was widened by adding types null to media type application/json of response 200

      response-property-list-of-types-widened

    • ●

      removed the optional property from the response with the status

      response-optional-property-removed

    • ●

      removed the optional property from the response with the status

      response-optional-property-removed

    • ●

      added the new boolean enum value to the response property for the response status

      response-property-enum-value-added

    • ●

      added the new float enum value to the response property for the response status

      response-property-enum-value-added

    • ●

      added the new int enum value to the response property for the response status

      response-property-enum-value-added

    • ○

      endpoint deprecated

      endpoint-deprecated

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    • ○

      added the optional property to the response with the status

      response-optional-property-added

    This revision also has 18 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog