admin/evaluation/task

Create Evaluation Task

Create an evaluation task from the evaluation dataset.

Args: evaluation_task.name: The name of the evaluation task. evaluation_task.evaluation_dataset_id: The ID of the uploaded evaluation dataset. evaluation_task.chat_engine: The chat engine to evaluate the queries against. Default is "default". evaluation_task.run_size: The number of queries to evaluate. Default is None, which means all queries in the CSV file.

Returns: True if the evaluation task is created successfully.

post/api/v1/admin/evaluation/tasks

Request

  • Base URL: https://tidb.ai (the document declares no server; this is the origin it was published from)
  • URL: https://tidb.ai/api/v1/admin/evaluation/tasks
  • Auth: API key in cookie session

Request body

namestring required
evaluation_dataset_idinteger required
chat_enginestring
run_sizeinteger nullable

Response

Successful Response

created_atstring date-time nullable
updated_atstring date-time nullable
idinteger nullable
namestring required
user_idstring uuid required
dataset_idinteger required

Changes

No recorded changes to this operation across all 1 revision of this API.