Evals

Changed on

Creates an eval run.

post/experimental/eval-runs-v2

Request

  • Base URL: https://api.tessl.io
  • URL: https://api.tessl.io/experimental/eval-runs-v2
  • Auth: none declared

Headers

Authorizationstring

Request body

workspaceNamestring required
scenariosobject required

Per-scenario tarballs and fixtures, keyed by scenario path

evalRunFixturesobject
skipForcedContextActivationboolean
skipScoringboolean
agentstring
modelstring
scorerAgentstring
scorerModelstring
runsinteger
skipSolvedboolean
runQualityCheckboolean
labelstring

Response

Default Response

Changes

  • 33081fb139c8Revision changes
    • info

      added the new optional request property

  • b777eddaa913Revision changes
    • info

      added subschema #3 to the / request property anyOf list

    • info

      request property deprecated

    • info

      request property // deprecated

    • info

      request property // deprecated