eval

Create an eval run

Changed on

Queues an asynchronous QStash-backed evaluation run and returns immediately.

post/api/v1/eval/runs

Request

  • Base URL: https://app.lobehub.com
  • URL: https://app.lobehub.com/api/v1/eval/runs
  • Auth: HTTP bearer

Request body

executionMode'internal' | 'external'
experimentIdstring
datasetIdstring required
idstring
namestring
targetAgentIdstring required

Response

Successful response

messagestring
successtrue required
timestampstring date-time required

Changes

  • fed653c22d7dRevision changes
    • breaking

      the response property const value false was removed for the status

    • breaking

      response property data/metrics list-of-types was widened by adding types null to media type application/json of response 202

    • breaking

      response property data/startedAt list-of-types was widened by adding types null to media type application/json of response 202

    • breaking

      the response's property type changed from string to array for status

    • breaking

      removed the required property from the response with the status

    • warning

      added the new false enum value to the response property for the response status

    • info

      added the new optional request property /

    • info

      added the new optional request property /

    • info

      added the new optional request property

    • info

      added the new optional request property

    • info

      the response property / became required for the status

    • info

      the response property / became required for the status

    • info

      the response property / became required for the status

    • info

      the response property / became required for the status

    • info

      the / response's property pattern ^(?:(?:\d\d[2468][048]|\d\d[13579][26]|\d\d0[48]|[02468][048]00|[13579][26]00)-02-29|\d{4}-(?:(?:0[13578]|1[02])-(?:0[1-9]|[12]\d|3[01])|(?:0[469]|11)-(?:0[1-9]|[12]\d|30)|(?:02)-(?:0[1-9]|1\d|2[0-8])))T(?:(?:[01]\d|2[0-3]):[0-5]\d:[0-5]\d(?:\.\d+)?(?:Z))$ was added for the status

    • info

      the / response's property pattern ^(?:(?:\d\d[2468][048]|\d\d[13579][26]|\d\d0[48]|[02468][048]00|[13579][26]00)-02-29|\d{4}-(?:(?:0[13578]|1[02])-(?:0[1-9]|[12]\d|3[01])|(?:0[469]|11)-(?:0[1-9]|[12]\d|30)|(?:02)-(?:0[1-9]|1\d|2[0-8])))T(?:(?:[01]\d|2[0-3]):[0-5]\d:[0-5]\d(?:\.\d+)?(?:Z))$ was added for the status

    • info

      added the required property to the response with the status

    • info

      added the required property / to the response with the status

    • info

      added the required property / to the response with the status

    • info

      added the required property / to the response with the status

    • info

      added the required property / to the response with the status

  • ceacc8af240dRevision changes
    • info

      endpoint added