Chunking

Parse text

Split large text documents into smaller, manageable chunks using different chunking strategies optimized for RAG (Retrieval-Augmented Generation) workflows. This endpoint supports multiple chunking algorithms including token-based, sentence-based, recursive, semantic, and specialized strategies.

post/v2/chunking

Request body

OR
OR
OR
OR
OR
OR

Example request

{
  "model": "openai/gpt-4.1"
}

Response

Text successfully chunked

Changes

Changed in 8 of the 251 revisions of this API.3910

  • addad33219df32See the full diff
    • the chunks/items/metadata/end_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/start_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/token_count response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • added subschema #7: Late Chunker Strategy to the request body oneOf list

      request-body-one-of-added

    • added the required property chunks/items/id to the response with the 200 status

      response-required-property-added

    This revision also has 31 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

    • removed subschema #7: Late Chunker Strategy from the request body oneOf list

      request-body-one-of-removed

    • the response property chunks/items/metadata/end_index became nullable for the status 200

      response-property-became-nullable

    • the response property chunks/items/metadata/start_index became nullable for the status 200

      response-property-became-nullable

    • the response property chunks/items/metadata/token_count became nullable for the status 200

      response-property-became-nullable

    • the chunks/items/index response's property type/format changed from integer/int32 to number/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/end_index response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/start_index response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/token_count response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • removed the required property chunks/items/id from the response with the 200 status

      response-required-property-removed

    This revision also has 173 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • 4fdc24e562eb32See the full diff
    • the chunks/items/metadata/end_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/start_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/token_count response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • added subschema #7: Late Chunker Strategy to the request body oneOf list

      request-body-one-of-added

    • added the required property chunks/items/id to the response with the 200 status

      response-required-property-added

    This revision also has 31 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

    • removed subschema #7: Late Chunker Strategy from the request body oneOf list

      request-body-one-of-removed

    • the response property chunks/items/metadata/end_index became nullable for the status 200

      response-property-became-nullable

    • the response property chunks/items/metadata/start_index became nullable for the status 200

      response-property-became-nullable

    • the response property chunks/items/metadata/token_count became nullable for the status 200

      response-property-became-nullable

    • the chunks/items/index response's property type/format changed from integer/int32 to number/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/end_index response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/start_index response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/token_count response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • removed the required property chunks/items/id from the response with the 200 status

      response-required-property-removed

    This revision also has 175 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

    • the chunk_size request property default value changed from 512 to 512

      request-property-default-value-changed

    • the min_characters_per_chunk request property default value changed from 24 to 24

      request-property-default-value-changed

  • f54fa34db0f432See the full diff
    • the chunks/items/metadata/end_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/start_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/token_count response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • added subschema #7: Late Chunker Strategy to the request body oneOf list

      request-body-one-of-added

    • added the required property chunks/items/id to the response with the 200 status

      response-required-property-added

    This revision also has 31 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

    • removed subschema #7: Late Chunker Strategy from the request body oneOf list

      request-body-one-of-removed

    • the response property chunks/items/metadata/end_index became nullable for the status 200

      response-property-became-nullable

    • the response property chunks/items/metadata/start_index became nullable for the status 200

      response-property-became-nullable

    • the response property chunks/items/metadata/token_count became nullable for the status 200

      response-property-became-nullable

    • the chunks/items/index response's property type/format changed from integer/int32 to number/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/end_index response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/start_index response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • the chunks/items/metadata/token_count response's property type/format changed from integer/int32 to number null/ for status 200

      response-property-type-changed

    • removed the required property chunks/items/id from the response with the 200 status

      response-required-property-removed

    This revision also has 173 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

  • d46bd23ae34c32See the full diff
    • the chunks/items/metadata/end_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/start_index response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • the chunks/items/metadata/token_count response's property type/format changed from number null/ to integer/int32 for status 200

      response-property-type-changed

    • added subschema #7: Late Chunker Strategy to the request body oneOf list

      request-body-one-of-added

    • added the required property chunks/items/id to the response with the 200 status

      response-required-property-added

    This revision also has 29 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

Of the 251 revisions, 71 have no diff computed.