Neural Chunker

Splits text using a fine-tuned BERT model to detect semantic shifts, creating topic-coherent chunks.

post/v1/chunk/neural

Response

Successful Response: A list of Chunk objects.

textstring

The actual text content of the chunk.

start_indexinteger

The starting character index of the chunk within the original input text.

end_indexinteger

The ending character index (exclusive) of the chunk within the original input text.

token_countinteger

The number of tokens in this specific chunk, according to the tokenizer used.

contextstring nullable

Chunk context.

Changed in 2 of the 20 revisions of this API.2

May 4, 202533dc37e4abcd1See the full diff
- ○
  added the optional property items/context to the response with the 200 status
  response-optional-property-added
Apr 29, 2025e12d0b1f23dc1See the full diff
- ○
  endpoint added
  endpoint-added