HUhuggingface

List of parquet files

Changed on

The dataset is converted to the parquet format. The endpoint gives the list of the parquet files. The same split can have multiple parquet files, called shards. They are sorted by their shard index.

get/parquet

Request

  • Base URL
    https://datasets-server.huggingface.co
  • URL
    https://datasets-server.huggingface.co/parquet
  • Auth
    • none
    • or HTTP bearer
    • or HTTP bearer

Query parameters

datasetstring required

The identifier of the dataset on the Hub.

configstring

The dataset subset on which to filter the response.

Response

A list of parquet files.</br>Beware: the response is not paginated.

featuresobject
partialboolean required

True means that the response has been computed on part of the dataset (typically the first 5GB). False means that the complete dataset was used.

Changes