Evals

Changed on

Returns side-by-side stats for 2-10 eval runs over the same scenarios. Scenarios linked to every run are grouped and labeled with the dimensions that vary (e.g. model). Scenarios linked to only some runs are listed as uncomparable. Responds 400 when fewer than 2 or more than 10 distinct run IDs are given.

get/experimental/eval-run-comparisons

Request

  • Base URL: https://api.tessl.io
  • URL: https://api.tessl.io/experimental/eval-run-comparisons
  • Auth: none declared

Query parameters

string uuid required
OR
string[] required

Eval-run UUIDs as a repeated query parameter (runs=a&runs=b). Must resolve to 2-10 distinct IDs.

Response

Default Response

Changes

  • e57a144d1cabRevision changes
    • info

      added the required property ////////// to the response with the status

  • ffb03b5d287fRevision changes
    • info

      added the optional property ///////// to the response with the status