model-hub

POST /model-hub/eval-templates/create-v2/

Create a single eval template with the revamped schema. Supports the new scoring fields (pass_threshold, choice_scores, output_type_normalized).

post/model-hub/eval-templates/create-v2/

Request

  • Base URL: http://localhost:8000
  • URL: http://localhost:8000/model-hub/eval-templates/create-v2/
  • Auth: one of:
    • API key in header X-Api-Key
    • API key in header X-Secret-Key

Request body

namestring
is_draftboolean
eval_type'llm' | 'code' | 'agent'
instructionsstring
modelstring
output_type'pass_fail' | 'percentage' | 'deterministic'
pass_thresholdnumber
choice_scoresobject nullable
descriptionstring nullable
tagsstring[]
check_internetboolean
codestring nullable
code_language'python' | 'javascript' nullable
messagesobject[] nullable
few_shot_examplesobject[] nullable
mode'auto' | 'agent' | 'quick' nullable
toolsobject nullable
knowledge_basesstring[] nullable
data_injectionobject nullable
summaryobject nullable
error_localizer_enabledboolean
template_format'mustache' | 'jinja'

Response

OK

statusboolean required

Changes

No recorded changes to this operation across all 1 revision of this API.