/

Docs
History
Schema
Generate

Filter operations

AI Agents2

Call Logs2

dashboards15

Evaluators35

Metrics4

observability54

Observability1

Results17

Runs7

Scenarios6

schedules4

Schedules1

slack1

test_framework143

get/test_framework/billing/info/Get billing information
get/test_framework/billing/payment-history/Get payment history
get/test_framework/billing/unit-usage-report/Get monthly usage and credits per billable unit
patch/test_framework/metric-reviews/{id}/Update a metric review
post/test_framework/metric-reviews/process_feedbacks/Improve a metric from feedback
post/test_framework/metric-reviews/process_feedbacks_answer/
get/test_framework/metric-reviews/process_feedbacks_progress/Get metric improvement progress
post/test_framework/test-sets/create_from_call_log/Create a test set from a production call log
post/test_framework/test-sets/create_from_run/Create a test set from a previous test run
get/test_framework/v1/critical-metric-scenarios/List critical metric scenarios
patch/test_framework/v1/critical-metric-scenarios/{id}/Update a critical metric scenario
patch/test_framework/v1/metrics-external/reorder/Reorder project metrics
delete/test_framework/v1/metrics/{id}/Delete a metric
post/test_framework/v1/metrics/{id}/run_reviews/
post/test_framework/v1/metrics/bulk_create/Create multiple metrics in a single request
post/test_framework/v1/metrics/generate_clean_description/
post/test_framework/v1/metrics/generate_clean_description_bg/Start async clean description generation
get/test_framework/v1/metrics/generate_clean_description_progress/Poll async clean description generation
post/test_framework/v1/metrics/generate_evaluation_trigger/
post/test_framework/v1/metrics/generate_metrics/
get/test_framework/v1/metrics/generate_metrics_progress/
post/test_framework/v1/metrics/preview/
get/test_framework/v1/metrics/preview-progress/
patch/test_framework/v1/metrics/reorder/Reorder project metrics
get/test_framework/v1/metrics/run_reviews_progress/
post/test_framework/v1/metrics/simplify_prompt/
get/test_framework/v1/metrics/simplify_prompt_progress/
get/test_framework/v1/personalities/List personalities
post/test_framework/v1/personalities/Create a personality
post/test_framework/v1/personalities-external/clone_voice/
get/test_framework/v1/personalities/{id}/Retrieve a personality
delete/test_framework/v1/personalities/{id}/Delete a personality
patch/test_framework/v1/personalities/{id}/Update a personality
post/test_framework/v1/personalities/{id}/fork/Fork a personality into a project
get/test_framework/v1/personalities/cartesia_voices/List Cartesia voices
post/test_framework/v1/personalities/clone_voice/
get/test_framework/v1/personalities/elevenlabs_voices/List ElevenLabs voices
get/test_framework/v1/phone-numbers/inbound/List inbound phone numbers
get/test_framework/v1/predefined-metrics/List predefined metrics
post/test_framework/v1/predefined-metrics/copy/Attach predefined metrics to a project
post/test_framework/v1/results/{id}/evaluate_metrics/
post/test_framework/v1/results/{id}/rerun/Re-run the scenarios from a completed test result
get/test_framework/v1/runs/{id}/logs/Retrieve execution logs for a simulation run
get/test_framework/v1/runs/{id}/trace/Get a run's trace
post/test_framework/v1/scenario-improvement-sessions/Create a scenario improvement session
get/test_framework/v1/scenario-improvement-sessions/{id}/Get a scenario improvement session
patch/test_framework/v1/scenario-improvement-sessions/{id}/Update a scenario improvement session
get/test_framework/v1/scenarios/List evaluators
put/test_framework/v1/scenarios-external/{id}/condition-audio/{audio_id}/Replace an audio clip's recording
patch/test_framework/v1/scenarios-external/{id}/condition-audio/{audio_id}/Correct an audio clip's transcript and word timings
get/test_framework/v1/scenarios/{id}/Retrieve an evaluator
delete/test_framework/v1/scenarios/{id}/Delete an evaluator
put/test_framework/v1/scenarios/{id}/condition-audio/{audio_id}/Replace an audio clip's recording
patch/test_framework/v1/scenarios/{id}/condition-audio/{audio_id}/Correct an audio clip's transcript and word timings
post/test_framework/v1/scenarios/create-from-transcript-bg/
get/test_framework/v1/scenarios/create-from-transcript-progress/
post/test_framework/v1/scenarios/create_folder/Create a folder
post/test_framework/v1/scenarios/delete_folder/
get/test_framework/v1/scenarios/folders/
post/test_framework/v1/scenarios/generate-bg/
post/test_framework/v1/scenarios/generate-instructions/
get/test_framework/v1/scenarios/generate-progress/
post/test_framework/v1/scenarios/improve_instructions/
get/test_framework/v1/scenarios/instructions-progress/
post/test_framework/v1/scenarios/move_folder/
post/test_framework/v1/scenarios/rename_folder/
post/test_framework/v1/scenarios/scenario-agent/
get/test_framework/v1/scenarios/scenario-agent-progress/
post/test_framework/v1/scenarios/validate_scenarios_json/Validate a JSON test-suite spec without running it
get/test_framework/v1/test-profiles/List test profiles
post/test_framework/v1/test-profiles/Create a test profile
get/test_framework/v1/test-profiles/{id}/Get a test profile
delete/test_framework/v1/test-profiles/{id}/Delete a test profile
patch/test_framework/v1/test-profiles/{id}/Update a test profile
get/test_framework/v1/tools/List the mock tools in a project
get/test_framework/v1/tools/{id}/Get one mock tool
get/test_framework/v2/aiagents/List AI voice agents
post/test_framework/v2/aiagents/Create an AI voice agent
get/test_framework/v2/aiagents/{id}/Retrieve an AI voice agent
delete/test_framework/v2/aiagents/{id}/Delete an AI voice agent
post/test_framework/v2/aiagents/{id}/auto-fetch/Auto-fetch the agent configuration from its provider
get/test_framework/v2/aiagents/{id}/auto-fetch-progress/Poll status of an auto-fetch task
post/test_framework/v2/aiagents/{id}/disable_personalities/Disable personalities for an agent's project
post/test_framework/v2/aiagents/{id}/duplicate/Duplicate an AI voice agent
post/test_framework/v2/aiagents/{id}/enable_personalities/Enable personalities for an agent's project
get/test_framework/v2/aiagents/{id}/personalities/List personalities available to an agent
post/test_framework/v2/aiagents/{id}/upload_knowledge_base/Upload AI agent knowledge base
get/test_framework/v2/aiagents/provider-assistants/List assistants on a connected provider account
delete/test_framework/v2/metrics/{id}/Delete a metric
post/test_framework/v2/metrics/{id}/run_reviews/Run metric reviews
post/test_framework/v2/metrics/bulk_create/Create multiple metrics in a single request
post/test_framework/v2/metrics/generate_clean_description/Generate a clean metric description
post/test_framework/v2/metrics/generate_clean_description_bg/Start async clean description generation
get/test_framework/v2/metrics/generate_clean_description_progress/Poll async clean description generation
post/test_framework/v2/metrics/generate_evaluation_trigger/Generate a metric evaluation trigger
post/test_framework/v2/metrics/generate_metrics/Generate suggested metrics
get/test_framework/v2/metrics/generate_metrics_progress/Get metric generation progress
post/test_framework/v2/metrics/preview/Preview a metric
get/test_framework/v2/metrics/preview-progress/Get metric preview progress
patch/test_framework/v2/metrics/reorder/Reorder project metrics
get/test_framework/v2/metrics/run_reviews_progress/Get metric reviews progress
post/test_framework/v2/metrics/simplify_prompt/Simplify a metric prompt
get/test_framework/v2/metrics/simplify_prompt_progress/Get prompt simplification progress
get/test_framework/v2/results/List test results
get/test_framework/v2/results/{id}/Retrieve a test result
post/test_framework/v2/results/{id}/evaluate_metrics/Evaluate metrics on a result
post/test_framework/v2/results/{id}/rerun/Re-run the scenarios from a completed test result
get/test_framework/v2/runs/{id}/Retrieve a test run
get/test_framework/v2/runs/bulk/Get multiple runs
get/test_framework/v2/scenarios/List evaluators
get/test_framework/v2/scenarios/{id}/Retrieve an evaluator
delete/test_framework/v2/scenarios/{id}/Delete an evaluator
get/test_framework/v2/scenarios/{id}/condition-audio/List an evaluator's audio clips
post/test_framework/v2/scenarios/{id}/condition-audio/Upload an audio clip to an evaluator
put/test_framework/v2/scenarios/{id}/condition-audio/{audio_id}/Replace an audio clip's recording
patch/test_framework/v2/scenarios/{id}/condition-audio/{audio_id}/Correct an audio clip's transcript and word timings
post/test_framework/v2/scenarios/create-from-transcript-bg/Create a scenario from a transcript
get/test_framework/v2/scenarios/create-from-transcript-progress/Get scenario-from-transcript progress
post/test_framework/v2/scenarios/create_folder/Create a folder
post/test_framework/v2/scenarios/delete_folder/Delete a scenario folder
get/test_framework/v2/scenarios/folders/List scenario folders
post/test_framework/v2/scenarios/generate-bg/Generate scenarios in background
post/test_framework/v2/scenarios/generate-instructions/Generate scenario instructions
get/test_framework/v2/scenarios/generate-progress/Get scenario generation progress
post/test_framework/v2/scenarios/improve_instructions/Improve scenario instructions
get/test_framework/v2/scenarios/instructions-progress/Get scenario instructions progress
post/test_framework/v2/scenarios/move_folder/Move a scenario folder
post/test_framework/v2/scenarios/rename_folder/Rename a scenario folder
post/test_framework/v2/scenarios/scenario-agent/Clarify what evaluator scenarios should cover
get/test_framework/v2/scenarios/scenario-agent-progress/Get scenario-refinement progress
post/test_framework/v2/scenarios/validate_scenarios_json/Validate a JSON test-suite spec without running it
post/test_framework/v3/aiagents/Create agent
post/test_framework/v3/aiagents/{id}/auto-fetch/Auto-fetch agent from provider
post/test_framework/v3/metrics/{id}/run_reviews/Run metric reviews
post/test_framework/v3/metrics/generate_clean_description/Generate clean metric description
post/test_framework/v3/metrics/generate_metrics/Generate metrics
post/test_framework/v3/metrics/preview/Preview metric
post/test_framework/v3/metrics/simplify_prompt/Simplify metric prompt with AI
post/test_framework/v3/results/{id}/ask_about_failures/Ask about failed runs
post/test_framework/v3/scenarios/create-from-transcript/Create evaluator from transcript
post/test_framework/v3/scenarios/generate/Generate evaluator
post/test_framework/v3/scenarios/generate-instructions/Generate scenario instructions with AI
post/test_framework/v3/scenarios/improve_instructions/Improve scenario instructions with AI

user11

test_framework

Changes to Generate evaluator

post/test_framework/v3/scenarios/generate/

Nov 3, 2026a6fb6a739212 Revision changes
- info
  endpoint added