eval

createTestCase

Changed on

Creates accept an optional id: an identical replay returns the resource; conflicting id or identifier returns 409. Lists are paginated.

post/api/v1/eval/datasets/{datasetId}/test-cases

Request

  • Base URL: https://app.lobehub.com
  • URL: https://app.lobehub.com/api/v1/eval/datasets/{datasetId}/test-cases
  • Auth: HTTP bearer

Path parameters

datasetIdstring required

Request body

idstring
inputstring required
expectedstring
categorystring
choicesstring[]
caseIdstring
sortOrderinteger
evalMode'equals' | 'contains' | 'regex' | 'starts-with' | 'ends-with' | 'any-of' | 'numeric' | 'extract-match' | 'json-schema' | 'javascript' | 'python' | 'llm-rubric' | 'factuality' | 'answer-relevance' | 'similar' | 'levenshtein' | 'rubric' | 'external' nullable
evalConfigobject nullable

Response

Successful response

messagestring
successtrue required
timestampstring date-time required

Changes