Dataset

Complete a dataset upload and trigger processing

Changed on
post/api/v1/datasets/upload/complete

Request

Request body

s3_keystring required

S3 object key returned in the pre-signed URL response from /upload/initiate

namestring required

Human-readable name for the dataset

file_format'csv' | 'json' | 'jsonl' | 'parquet' | 'pdf' | 'docx' | 'pptx' | 'xlsx' | 'html' | 'zip' | 'txt' required

Format of the uploaded file

file_size_bytesnumber required

Size of the uploaded file in bytes

Example request

{
  "s3_key": "uploads/550e8400-e29b-41d4-a716-446655440000/my-training-data.csv",
  "name": "my-training-data",
  "file_format": "csv",
  "file_size_bytes": 1048576
}

Response

dataset_idstring required

ID of the newly created dataset

statusstring

Dataset status after POST /upload/complete. preprocessing_failed when the uploaded files do not share one column schema. Omitted by provider initiate endpoints, which finish in the background.

Example response

{
  "dataset_id": "550e8400-e29b-41d4-a716-446655440000",
  "status": "awaiting_preprocessing"
}

Changes