Token Chunker

Chunk the given text using the Token Chunker.

Request body

tokenizerstring

chunk_sizeinteger

chunk_overlapinteger

return_typestring

Successful Response: A list of standard chunk objects.

textstring

The actual text content of the chunk.

start_indexinteger

The starting character index of the chunk within the original input text.

end_indexinteger

The ending character index (exclusive) of the chunk within the original input text.

token_countinteger

The number of tokens in this specific chunk, according to the tokenizer used.