simulate

Add an eval to the environment and grade this run's already-finished calls with it.

post/simulate/api/harness-environments/{id}/runs/{execution_id}/evaluations/

Request

  • Base URL: http://localhost:8000
  • URL: http://localhost:8000/simulate/api/harness-environments/{id}/runs/{execution_id}/evaluations/
  • Auth: one of:
    • API key in header X-Api-Key
    • API key in header X-Secret-Key

Request body

namestring required

Response

Accepted

queuedinteger required

Stamped and scheduled for dispatch -- not yet dispatched. A call whose stamp committed but whose grading job then failed to queue is still counted here, not subtracted.

skipped_existinginteger required
skipped_in_flightinteger required
skipped_pendinginteger required
completed_callsinteger required

Changes

No recorded changes to this operation across all 1 revision of this API.