Benchmark

Creates a participant in a benchmark.

Changed on
post/benchmark/{benchmarkId}/participants

Request

  • Base URL
    https://api.rapidata.ai
  • URL
    https://api.rapidata.ai/benchmark/{benchmarkId}/participants
  • Auth
    OpenID Connect (https://auth.rapidata.ai/.well-known/openid-configuration, scopes: openid, profile, email, offline_access, api)

Path parameters

benchmarkIdstring required

The id of the benchmark the participant will be added to.

Request body

namestring required

The name of the participant.

familystring nullable

The family the underlying model belongs to (e.g. "Flux", "GPT"), if any.

labstring nullable

The lab that makes the model (e.g. "OpenAI", "Black Forest Labs"), if any.

proprietaryNamestring nullable

The vendor-facing display name of the model, if any.

licenseType'OpenSource' | 'Proprietary' nullable

The license classification of the underlying model behind a participant.

costnumber double nullable

The model's price in USD per costUnit. Required together with costUnit.

costUnit'UsdPerImage' | 'UsdPerVideoSecond' | 'UsdPerMillionTokens' | 'UsdPerSample' nullable

The unit a model's cost is quoted in. Costs are only comparable within one unit.

Response

OK

participantIdstring required

The id of the created participant.

datasetIdstring required

The id of the participant's dataset.

Changes

  • c72c9f1c8ef5Revision changes
    • breaking

      removed the enum value undefined of the request property ////

    • breaking

      removed the enum value undefined of the request property ////

  • ee9d3d550b23Revision changes
    • info

      added the new UsdPerSample enum value to the request property ////