hosted-evaluations

Create Hosted Evaluation

Changed on

Create and start a hosted evaluation.

post/api/v1/hosted-evaluations

Request

  • Base URL
    https://api.primeintellect.ai
  • Auth
    HTTP bearer

Request body

environment_idsstring[] required

List of environment IDs to evaluate

inference_modelstring required

Model ID for inference

team_idstring nullable

Optional team ID to own the hosted evaluation

namestring nullable

Optional custom evaluation name

Response

Successful Response

evaluation_idstring required

ID of the created evaluation

sandbox_idstring nullable

ID of the sandbox running the evaluation

statusstring required

Current status of the evaluation

evaluation_idsstring[] nullable

List of evaluation IDs if multiple environments were provided

errorstring nullable

Error message if creation failed

Changes

    • info

      added the new optional request property /

    • info

      the request property default value changed from false to true

    • info

      the request property default value changed from false to true

    • info

      endpoint added