ServerEvals

Trigger a new eval run for a suite. Returns 202 while the run executes in the background.

post/api/v1/server-evals/{serverId}/suites/{suiteId}/runs

Request

  • Base URL: https://cloud.manufact.com
  • URL: https://cloud.manufact.com/api/v1/server-evals/{serverId}/suites/{suiteId}/runs
  • Auth: none declared

Path parameters

serverIdstring required
suiteIdstring uuid required

Query parameters

branchstring
client'chatgpt' | 'codex' | 'both'

Response

Accepted

idstring required
suiteIdstring required
serverIdstring required
createdBystring nullable required
statusstring required
serverUrlstring nullable required
environmentBranchstring nullable required
impersonatedboolean required
promptstring nullable required
flowunknown required
messagesunknown required
requiredToolsunknown required
toolNamesunknown required
scoreinteger nullable required
passboolean nullable required
startedAtstring date-time required
completedAtstring date-time required
createdAtstring date-time required
updatedAtstring date-time required

Changes

No recorded changes to this operation across all 1 revision of this API.