experiments

Evaluate Experiment Adhoc

Changed on

Evaluate an existing experiment with a specific evaluator.

This triggers immediate evaluation using the run_over_dataset approach, processing runs in batches to handle large experiments efficiently.

post/api/v1/runs/experiments/{experiment_id}/evaluate

Request

  • Base URL
    https://api.smith.langchain.com
  • URL
    https://api.smith.langchain.com/api/v1/runs/experiments/{experiment_id}/evaluate
  • Auth
    • API key in header X-API-Key
    • or API key in header X-Tenant-Id
    • or HTTP bearer

Path parameters

experiment_idstring uuid required

Request body

rule_idstring uuid required

Response

Successful Response

object required

Changes

  • 1a8ee9358d81Revision changes
    • breaking

      the / response's property type changed from object to string for status

    • breaking

      removed the required property // from the response with the status

    • breaking

      removed the required property // from the response with the status

    • breaking

      removed the required property // from the response with the status