Account1

Adhoc Retrievers3

Agent Sessions11

Alerts16

Analytics41

Annotations9

Apps34

Batches4

Bucket Batches22

Bucket Objects10

Bucket Syncs15

Bucket Uploads7

Buckets7

BYO Documents5

Cluster Executions7

Cluster Triggers8

Clusters9

Collection Documents19

Collection Lifecycle2

Collection Schema1

Collection Taxonomies1

Collections14

Custom Models8

Data Subject Access Requests3

Discovery4

Document Lineage3

Documents6

Events1

Extractor Publishing5

Extractors5

Feature Extractors2

Feature Search1

Features1

Health4

Inference1

Manifest7

Marketplace14

Models6

Namespace Clone1

Namespace Extractors2

Namespace Migrations7

Namespace Snapshots6

Namespaces10

Notifications12

Onboarding2

Organization API Keys5

Organization Audit5

Organization Billing22

Organization Connections8

Organization Infrastructure1

Organization Secrets4

Organization Targets1

Organization Usage3

Organization Users5

Organizations3

Pricing1

Public Apps API5

Public Extractor Marketplace2

Public Notifications API1

Public Retriever API7

Public Templates API8

Published Retrievers8

Quickstart1

Resource Search1

Retriever API Keys3

Retriever Benchmarks4

Retriever Evaluations9

Retriever Interactions5

Retriever Stages1

Retrievers15

Scaffold Templates3

Signup1

Source Adapter2

Support14

Tasks3

Taxonomies13

Taxonomy Analytics6

Templates23

Triggers10

Webhooks5

Retriever Benchmarks

Create benchmark

Changed on Oct 9, 2026

Create a new benchmark run to compare retriever pipelines. The benchmark will replay historical sessions and measure alignment with observed user behavior.

post/v1/retrievers/benchmarks

Request

Base URL: https://api.mixpeek.com
URL: https://api.mixpeek.com/v1/retrievers/benchmarks
Auth: HTTP bearer and API key in header X-Namespace

Request body

benchmark_namestring required

Human-readable name for this benchmark.

baseline_retriever_idstring required

ID of the baseline retriever pipeline to compare against.

candidate_retriever_idsstring[] required

IDs of candidate retriever pipelines to evaluate.

session_countinteger

Number of sessions to include in the benchmark.

Response

Successful Response

benchmark_idstring required

Unique benchmark identifier.

benchmark_namestring required

Human-readable name.

baseline_retriever_idstring required

Baseline retriever ID.

candidate_retriever_idsstring[] required

Candidate retriever IDs.

session_countinteger required

Number of sessions in benchmark.

Status of a benchmark run.

comparisonBenchmarkComparison (unresolved $ref)

created_atstring date-time required

Creation timestamp.

started_atstring date-time nullable

Execution start time.

completed_atstring date-time nullable

Completion time.

error_messagestring nullable

Error message if failed.

Changes

Oct 9, 202661a175e8eb9a Revision changes
- warning
  removed the optional property from the response with the status
- info
  added the non-success response with the status
- info
  added the non-success response with the status
- info
  added the optional property to the response with the status
- info
  added the required property to the response with the status
- info
  added the required property to the response with the status
Oct 4, 202638e0822db900 Revision changes
- breaking
  removed the success response with the status
- info
  added the success response with the status

Operation history (3 revisions)