Benchmark

Complete a BenchmarkRun.

Changed on

Complete a currently running BenchmarkRun.

post/v1/benchmarks/runs/{id}/complete

Request

  • Base URL: https://api.runloop.ai
  • URL: https://api.runloop.ai/v1/benchmarks/runs/{id}/complete
  • Auth: HTTP bearer

Path parameters

idstring required

The BenchmarkRun ID.

Response

OK

idstring required

The ID of the BenchmarkRun.

benchmark_idstring nullable

The ID of the Benchmark definition. Present if run was created from a benchmark definition.

namestring nullable

The name of the BenchmarkRun.

start_time_msinteger required

The time the benchmark run execution started (Unix timestamp milliseconds).

duration_msinteger nullable

The duration for the BenchmarkRun to complete.

state'running' | 'canceled' | 'completed' | 'failed' required
scorenumber float nullable

The final score across the BenchmarkRun, present once completed. Calculated as sum of scenario scores / number of scenario runs.

metadataobject required

User defined metadata to attach to the benchmark run for organization.

purposestring nullable

Purpose of the run.

environment_variablesobject nullable

Environment variables used to run the benchmark.

secrets_providedobject nullable

User secrets used to run the benchmark. Example: {"DB_PASS": "DATABASE_PASSWORD"} would set the environment variable 'DB_PASS' on all scenario devboxes to the value of the secret 'DATABASE_PASSWORD'.

Changes

  • 0568973e19e8Revision changes
    • warning

      added the new failed enum value to the response property for the response status

  • e583f34fdcdcRevision changes
    • info

      api operation id completeBenchmarkRun removed and replaced with completeBenchmarkRunDeprecated

    • info

      endpoint deprecated