---
title: "Validate performance accuracy against provider benchmarks"
method: GET
path: "/simulations/{simulationId}/validate-performance-accuracy"
tags: ["Simulations"]
---

# Validate performance accuracy against provider benchmarks

`GET /simulations/{simulationId}/validate-performance-accuracy`

## Request

- Base URL: `https://www.cloudworldmodel.ai/api`
- URL: `https://www.cloudworldmodel.ai/api/simulations/{simulationId}/validate-performance-accuracy`
- Auth: none required

Compares the simulation's throughput and latency estimates against known
real-world provider benchmarks. Returns a validation result indicating
whether the simulated performance metrics are within the acceptable
tolerance (±15%).

**Skip semantics:** Resources without a `serviceFamily` characteristic
are skipped entirely. For resources that do have a `serviceFamily`,
individual metrics (`max_throughput`, `baseline_latency`,
`max_connections`) are skipped when no benchmark entry exists for that
provider/metric combination. When all resource-metric pairs are skipped,
`validations` is empty, `summary.total` is `0`, and `checked` is `false`.
In that state `valid: true` means "no failures among the zero pairs
checked" — it does **not** mean the simulation's performance accuracy
was verified. Always check `checked: true` before acting on `valid`.

Requires `read` scope and ownership.

## Path parameters

- `simulationId` string, required

## Response `200`

Performance accuracy validation result

- object
  - `valid` boolean: Whether all checked resource-metric pairs are within the ±15% performance tolerance. Only meaningful when `checked` is `true`.
  - `checked` boolean: `true` when at least one resource-metric pair had a matching performance benchmark and was evaluated. `false` means no comparable data was found — the simulation resources may lack `serviceFamily`, or no performance benchmark exists for the provider/metric combination. When `checked` is `false`, `valid: true` does **not** mean accuracy was verified.
  - `validations` object[]: Per-resource-metric performance validation results
    - `resource` string
    - `provider` string
    - `serviceFamily` string
    - `size` string
    - `metric` string: The metric that was validated. One of: `max_throughput`, `baseline_latency`, `max_connections`.
    - `simulatedValue` number
    - `benchmarkValue` number
    - `deviation` number: Absolute percentage deviation from benchmark
    - `withinThreshold` boolean
    - `unit` string
    - `source` string
  - `summary` object
    - `total` integer: Number of resource-metric pairs that had a matching benchmark
    - `passed` integer
    - `failed` integer
    - `avgDeviation` number
    - `skippedCount` integer: Number of resource-metric pairs that were skipped because no benchmark was found.
    - `skippedReasons` string[]: Human-readable explanation for each skipped resource-metric pair.

## Other responses

- `401`: No credentials provided to an API-key-protected endpoint. The response body includes a machine-readable `apiKeyAuth` block pointing to the key creation endpoint so agents can self-serve an API key without consulting the spec.
- `403`: Access denied
- `404`: Resource not found
- `500`: Internal server error

---

[API](https://skmtc.dev/cloudworldmodel/apis/cloud-world-model-agent-api.md) · [All operations](https://skmtc.dev/cloudworldmodel/apis/cloud-world-model-agent-api/llms.txt) · [OpenAPI document](https://skmtc.dev/cloudworldmodel/apis/cloud-world-model-agent-api/revisions/ecc3ad1ff07f?raw)
