--- title: "GET /simulate/v3/test-executions/{test_execution_id}/analytics/" method: GET path: "/simulate/v3/test-executions/{test_execution_id}/analytics/" tags: ["simulate"] --- # GET /simulate/v3/test-executions/{test_execution_id}/analytics/ `GET /simulate/v3/test-executions/{test_execution_id}/analytics/` ## Request - Base URL: `http://localhost:8000` - URL: `http://localhost:8000/simulate/v3/test-executions/{test_execution_id}/analytics/` - Auth: one of: - API key in header `X-Api-Key` - API key in header `X-Secret-Key` ## Response `200` OK - RunAnalyticsV3Response - `dashboard` RunDashboardV3, required - `metrics` RunDashboardMetric[], required - `key` string, required - `label` string, required - `value` number, nullable, required - `unit` 'number' | 'percent' | 'ms' | 'seconds' | 'ratio' | 'cents', required - `measured` integer, nullable, required - `total` integer, required - `note` string, required - `breakdowns` RunDashboardBreakdown[], required - `key` string, required - `label` string, required - `total` integer, required - `segments` RunDashboardSegment[], required - `label` string, required - `count` integer, required - `share` number, required - `statuses` string[] - `headline` RunDashboardSegment, required - `label` string, required - `count` integer, required - `share` number, required - `statuses` string[] - `voice_slos` RunDashboardSlo[], required - `key` string, required - `average` number, nullable, required - `measured` integer, required - `max` number, nullable, required - `p50` number, nullable, required - `p90` number, nullable, required - `p99` number, nullable, required - `label` string, required - `interruptions` RunDashboardInterruptions, required - `total` integer, nullable, required - `measured` integer, required - `average` number, nullable, required - `series` RunDashboardSeries[], required - `label` string, required - `started_at` string, date-time, nullable, required - `calls` integer, required - `latency_ms` number, nullable, required - `duration_ms` number, nullable, required - `llm_cents` number, nullable, required - `tts_cents` number, nullable, required - `stt_cents` number, nullable, required - `storage_cents` number, nullable, required - `series_limit` integer, required - `series_mode` 'calls' | 'time_buckets', required - `agent_latency_percentiles` RunDashboardPercentile[], required - `percentile` integer, required - `value` number, nullable, required - `latency_percentiles` RunDashboardPercentile[], required - `percentile` integer, required - `value` number, nullable, required - `distributions` RunDashboardDistribution[], required - `key` string, required - `average` number, nullable, required - `measured` integer, required - `max` number, nullable, required - `p50` number, nullable, required - `p90` number, nullable, required - `p99` number, nullable, required - `csat` RunDashboardCsat, required - `bins` RunDashboardHistogramBin[], required - `label` string, required - `lower` number, required - `upper` number, required - `count` integer, required - `danger` boolean, required - `measured` integer, required - `total` integer, required - `satisfied` integer, required - `satisfied_percent` number, nullable, required - `agreement` RunDashboardAgreement, required - `compared` integer, required - `agreed` integer, required - `percent` number, nullable, required - `agent_response_time` RunDashboardResponseTime, required - `bins` RunDashboardHistogramBin[], required - `label` string, required - `lower` number, required - `upper` number, required - `count` integer, required - `danger` boolean, required - `measured` integer, required - `total` integer, required - `target_ms` integer, required - `p50` number, nullable, required - `p95` number, nullable, required - `at_or_above_target` integer, required - `at_or_above_target_percent` number, nullable, required - `pipeline_cost` RunDashboardPipelineCost[], required - `key` string, required - `label` string, required - `total_cents` number, nullable, required - `share` number, nullable, required - `tools` RunDashboardTools, required - `total_invocations` integer, required - `total_tools` integer, required - `volume` RunDashboardTool[], required - `name` string, required - `invocations` integer, required - `measured` integer, required - `failures` integer, required - `failure_rate` number, nullable, required - `failure_label` string, required - `failures` RunDashboardTool[], required - `name` string, required - `invocations` integer, required - `measured` integer, required - `failures` integer, required - `failure_rate` number, nullable, required - `failure_label` string, required - `slowest_tasks` RunDashboardTask[], required - `rank` integer, required - `id` string, uuid, required - `label` string, required - `axis_label` string, required - `value` number, required - `modality` string, nullable, required - `provider` string, nullable, required - `most_expensive_tasks` RunDashboardTask[], required - `rank` integer, required - `id` string, uuid, required - `label` string, required - `axis_label` string, required - `value` number, required - `modality` string, nullable, required - `provider` string, nullable, required - `unavailable_features` RunDashboardUnavailable[], required - `key` string, required - `reason` string, required - `evaluation_summary` RunDashboardEvaluationSummary, required - `graders` integer, required - `passed` integer, required - `measured` integer, required - `pass_rate` number, nullable, required - `errored_checks` integer, required - `use_case_risk` RunDashboardRisk[], required - `queued` integer, required - `in_progress` integer, required - `scenario` string, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `run_health` RunDashboardHealth, required - `show_banner` boolean, required - `attempted` integer, required - `ran_cleanly` integer, required - `connected` integer, required - `errored` integer, required - `not_evaluated` integer, required - `eval_errors` integer, required - `comparison` RunDashboardComparison, required - `available` boolean, required - `previous_execution_id` string, uuid, nullable, required - `shared_scenarios` integer, required - `newly_passing` string[], required - `newly_failing` string[], required - `goal_count` integer, required - `execution` AnalyticsExecution, required - `id` string, uuid, required - `name` string, required - `started_at` string, date-time, nullable, required - `completed_at` string, date-time, nullable, required - `summary` AnalyticsSummary, required - `total` integer, required - `outcomes` OutcomeCounts, required - `queued` integer, required - `in_progress` integer, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `measured` integer, required - `pass_rate` number, nullable, required - `duration` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `latency` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `tokens` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `cost_cents` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `evaluators` integer, required - `scenario_risk` Risk[], required - `total` integer, required - `outcomes` OutcomeCounts, required - `queued` integer, required - `in_progress` integer, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `measured` integer, required - `pass_rate` number, nullable, required - `duration` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `latency` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `tokens` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `cost_cents` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `scenario` string, required - `scenario_key` string, required - `reliability` Reliability, required - `trials` integer, required - `scenarios` integer, required - `consistent_pass` integer, required - `passed_at_least_once` integer, required - `repeated` integer, required - `flaky` integer, required - `flip_rate` number, nullable, required - `pass_rate_interval` ReliabilityInterval, nullable, required - `low` number, required - `high` number, required - `effective_n` number, required - `evaluated` integer, required - `clusters` integer, required - `rows` ReliabilityRow[], required - `queued` integer, required - `in_progress` integer, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `scenario` string, required - `scenario_key` string, required - `runs` integer, required - `evaluated` integer, required - `pass_rate` number, nullable, required - `verdict` 'passed' | 'failed' | 'flaky' | 'not_evaluated', required - `turn_distribution` TurnDistribution[], required - `queued` integer, required - `in_progress` integer, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `turn_count` integer, required - `evaluations` EvaluationSummary[], required - `id` string, required - `name` string, required - `passed` integer, required - `failed` integer, required - `measured` integer, required - `errored` integer, required - `missing` integer, required - `pass_rate` number, nullable, required - `average_score` number, nullable, required - `failure_breakdown` FailureBreakdown[], required - `reason` string, required - `failures` integer, required - `share` number, required - `distributions` Distributions, required - `duration_seconds` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `latency_ms` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `tokens` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `cost_cents` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `cost_breakdown_cents` CostComponents, required - `stt` CostComponent, required - `total` number, nullable, required - `measured` integer, required - `calls` integer, required - `llm` CostComponent, required - `total` number, nullable, required - `measured` integer, required - `calls` integer, required - `tts` CostComponent, required - `total` number, nullable, required - `measured` integer, required - `calls` integer, required - `storage` CostComponent, required - `total` number, nullable, required - `measured` integer, required - `calls` integer, required - `customer` CostComponent, required - `total` number, nullable, required - `measured` integer, required - `calls` integer, required - `provider_breakdown` ProviderBreakdown[], required - `total` integer, required - `outcomes` OutcomeCounts, required - `queued` integer, required - `in_progress` integer, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `measured` integer, required - `pass_rate` number, nullable, required - `duration` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `latency` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `tokens` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `cost_cents` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `provider` string, required - `modality_breakdown` ModalityBreakdown[], required - `total` integer, required - `outcomes` OutcomeCounts, required - `queued` integer, required - `in_progress` integer, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `measured` integer, required - `pass_rate` number, nullable, required - `duration` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `latency` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `tokens` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `cost_cents` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `modality` string, required - `trends` Trend[], required - `total` integer, required - `outcomes` OutcomeCounts, required - `queued` integer, required - `in_progress` integer, required - `passed` integer, required - `failed` integer, required - `error` integer, required - `inconclusive` integer, required - `measured` integer, required - `pass_rate` number, nullable, required - `duration` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `latency` MetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `tokens` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `cost_cents` TotalMetricStats, required - `average` number, nullable, required - `p50` number, nullable, required - `p75` number, nullable, required - `p90` number, nullable, required - `p95` number, nullable, required - `p99` number, nullable, required - `measured` integer, required - `total` integer, required - `total_value` number, nullable, required - `execution_id` string, uuid, required - `started_at` string, date-time, nullable, required ## Other responses - `default`: Default error response --- [API](https://skmtc.dev/futureagi/apis/future-agi-management-api.md) · [All operations](https://skmtc.dev/futureagi/apis/future-agi-management-api/llms.txt) · [OpenAPI document](https://skmtc.dev/futureagi/apis/future-agi-management-api/revisions/c8684118e142?raw)