Benchmark

Get scenario definitions for a Benchmark.

Changed on

Get scenario definitions for a previously created Benchmark.

get/v1/benchmarks/{id}/definitions

Request

  • Base URL: https://api.runloop.ai
  • URL: https://api.runloop.ai/v1/benchmarks/{id}/definitions
  • Auth: HTTP bearer

Path parameters

idstring required

The Benchmark ID.

Query parameters

limitinteger

The limit of items to return. Default is 20. Max is 5000.

starting_afterstring

Load the next page of data starting after the item with the given ID.

Response

OK

has_moreboolean required
total_countinteger nullable

Changes

    • info

      added the optional property //////////// to the response with the status

    • breaking

      the // response's property type changed from object to no type for status

    • breaking

      the // response's property type changed from string to no type for status

    • warning

      removed the optional property /// from the response with the status

    • warning

      removed the optional property /// from the response with the status

    • warning

      removed the optional property /// from the response with the status

    • warning

      removed the optional property /// from the response with the status

    • info

      added subschema #2 to the // response property anyOf list for the response status

    • info

      added subschema #2 to the // response property anyOf list for the response status

    • info

      removed the EVALUATION enum value from the // response property for the response status

    • info

      removed the FORWARD enum value from the // response property for the response status

    • info

      removed the REVERSE enum value from the // response property for the response status

    • info

      removed the UNSPECIFIED enum value from the // response property for the response status