Create a metric

URL-friendly unique identifier in snake_case format

Name of the metric. Example: "Customer Satisfaction" or "Appointment Booking"

Description of what the metric measures. Example: "Measures how satisfied customers are with the service provided"

Type of metric

• basic - Basic (Deprecated in favor of LLM Judge)
• custom_prompt - Custom Prompt ( Deprecated in favor of LLM Judge)
• custom_code - Custom Code
• llm_judge - LLM Judge

• binary - Binary
• continuous_qualitative - Continuous Qualitative
• numeric - Numeric
• enum - Enum

Whether this metric requires audio analysis. Example: true or false

Enable this metric for observability. Example: true or false

Enable this metric for simulations. Example: true or false

Enable sampling for this metric using its sample_rate, or the project sample rate when unset

Sampling rate for this metric (0.0 to 1.0). Overrides the project sample rate when set.

Evaluation prompt for the metric. Example: "Evaluate customer satisfaction based on conversation"

Predefined function name Example: "get_latency" or "check_critical_deviations"

Display order for the metric. Example: 1

Python custom code for the metric. Example:

_resul = True
_explanation = None
if  "call_end_reason" in data and data["call_end_reason"] == "customer_satisfaction":
    _result = True
    _explanation = "Customer expressed satisfaction with service"

• always - Always
• automatic - Automatic
• custom - Custom

• llm_judge - LLM Judge
• custom_code - Custom Code

Evaluation trigger prompt for the metric. Example: "Evaluate metric only if call ended reason is main-agent-ended-call"

Python custom code to determine metric relevance. Code should set _result (bool) and _explanation (str). Example:

_result = True
_explanation = "Metric is relevant"
if "call_end_reason" in data and data["call_end_reason"] == "customer-hung-up":
    _result = False
    _explanation = "Customer hung up, metric not applicable"

• openai - OpenAI
• gemini - Gemini
• dspy-gepa-gemini-flash - Dspy Gepa Gemini Flash
• deepseek-v4-flash - DeepSeek V4 Flash

• openai - OpenAI
• gemini - Gemini
• dspy-gepa-gemini-flash - Dspy Gepa Gemini Flash
• deepseek-v4-flash - DeepSeek V4 Flash

Vocera defined metric code for the metric. Example: "7fd534f5"

Priority assignment prompt for the metric.

Enable alerts for this metric when it fails (value=false). Only applicable to binary metrics (eval_type=binary). For other metric types, use significant_change_alert_status instead. Example: true or false

• disabled - Alerts Disabled
• normal - Normal Alerts
• significant_change - Significant Change Alerts

Alert status: enabled or disabled.

• enabled - Enabled
• disabled - Disabled

Alert direction: increase only, decrease only, or both (empty = both). Example: "increase", "decrease", or "both"

• `` - Both (Increase and Decrease)
• increase - Increase Only
• decrease - Decrease Only

When enabled, this metric is automatically assigned to new agents created in the project.

Slack workspace to send alerts to

Override channel ID for this metric's alerts

For observability_dropoff: when true, copies the dropoff_nodes from configuration to every other agent in the project.

If true, this metric is added to the project's call-success rubric on save (a sensible default rule is chosen by eval_type). If false on an existing rubric metric, it's removed from the rubric.

URL-friendly unique identifier in snake_case format. Example: "customer_satisfaction_1562"

Name of the metric. Example: "Customer Satisfaction" or "Appointment Booking"

Description of what the metric measures. Example: "Measures how satisfied customers are with the service provided"

Type of metric

• basic - Basic (Deprecated in favor of LLM Judge)
• custom_prompt - Custom Prompt ( Deprecated in favor of LLM Judge)
• custom_code - Custom Code
• llm_judge - LLM Judge

• binary - Binary
• continuous_qualitative - Continuous Qualitative
• numeric - Numeric
• enum - Enum

Whether this metric requires audio analysis. Example: true or false

Evaluation prompt for the metric. Example: "Evaluate customer satisfaction based on conversation"

• always - Always
• automatic - Automatic
• custom - Custom

Type of trigger evaluation: LLM judge or custom code. Only used when evaluation_trigger is CUSTOM. Example: "llm_judge" or "custom_code"

• llm_judge - LLM Judge
• custom_code - Custom Code

Evaluation trigger prompt for the metric. Example: "Evaluate metric only if call ended reason is main-agent-ended-call"

Python custom code to determine metric relevance. Code should set _result (bool) and _explanation (str). Example:

_result = True
_explanation = "Metric is relevant"
if "call_end_reason" in data and data["call_end_reason"] == "customer-hung-up":
    _result = False
    _explanation = "Customer hung up, metric not applicable"

Priority assignment prompt for the metric.

The overall score for this metric across all test sets

The total score for this metric

Knowledge base files associated with this metric

Enable this metric for observability. Example: true or false

Enable this metric for simulations. Example: true or false

Enable sampling for this metric using its sample_rate, or the project sample rate when unset

Sampling rate for this metric (0.0 to 1.0). Overrides the project sample rate when set.

Enable alerts for this metric when it fails (value=false). Only applicable to binary metrics (eval_type=binary). For other metric types, use significant_change_alert_status instead. Example: true or false

• disabled - Alerts Disabled
• normal - Normal Alerts
• significant_change - Significant Change Alerts

Slack workspace to send alerts to

Override channel ID for this metric's alerts

Alert status: enabled or disabled.

• enabled - Enabled
• disabled - Disabled

Alert direction: increase only, decrease only, or both (empty = both). Example: "increase", "decrease", or "both"

• `` - Both (Increase and Decrease)
• increase - Increase Only
• decrease - Decrease Only

Predefined function name Example: "get_latency" or "check_critical_deviations"

Python custom code for the metric. Example:

_resul = True
_explanation = None
if  "call_end_reason" in data and data["call_end_reason"] == "customer_satisfaction":
    _result = True
    _explanation = "Customer expressed satisfaction with service"

Vocera defined metric code for the metric. Example: "7fd534f5"

Window size for rolling statistics calculation. Example: 50

Standard deviation multiplier for threshold calculation. Example: 2.0

Alpha value for exponentially weighted moving average (EWMA) calculation. Example: 0.1

When enabled, this metric is automatically assigned to new agents created in the project.