datasets

Process Uploaded Dataset

Changed on

Queues processing for a reserved dataset upload.

post/v1/datasets/upload/process

Request

Request body

dataset_idstring required

Dataset ID from upload/url response (all metadata stored in DB)

Response

Successful Response

annotation_configobject nullable
annotation_progressobject nullable
annotation_status'none' | 'in_progress' | 'completed' nullable
column_mappingobject nullable

Column mapping from original to standard names

created_atstring required
dataset_namestring required
dataset_pathstring required
dataset_typestring required
generation_typestring nullable

Canonical operation that created this dataset version.

idstring required
is_competitionboolean

Whether this dataset is a competition benchmark

is_seedboolean nullable

Whether this dataset is a seed dataset (small set for review before full expansion)

labelsstring[] nullable

Label names (entity types for NER, class labels for classification). A training job accepts at most 250 unique labels across its datasets.

processing_errorstring nullable

Error message if status is failed

project_idstring nullable
root_dataset_idstring nullable
sample_sizeinteger nullable
schemaobject nullable
schema_warningsstring[] nullable
sizeinteger nullable
status'initialized' | 'uploading' | 'converting' | 'validating' | 'ready' | 'failed' | 'generating' | 'queued' nullable

Dataset status: initialized/uploading/converting/validating/ready/failed/generating/queued

synthesis_session_idstring nullable

UUID of the synthesis log session for this dataset, used to restore creation workflow on resume

train_rationumber nullable

Train split ratio for this dataset version. Left-to-right split with no shuffle; validation is the tail.

typestring

Dataset purpose tag: 'training', 'evaluation', or 'benchmark'

updated_atstring required
user_idstring required
validationobject nullable
version_numberstring
visibilitystring

Dataset visibility: 'private' or 'public'

Changes