---
title: "Token Chunk"
method: POST
path: "/v1/chunk/token"
tags: ["Chunking"]
---

# Token Chunk

`POST /v1/chunk/token`

Token chunking endpoint.

Chunks text based on token count using the specified tokenizer.

## Headers

- `authorization` string, nullable

## Request body

- TokenChunkerRequest — Request model for token chunking.
  - `text` union — Text or list of texts to chunk
    - string
    - string[]
  - `file` FileReference — File reference for chunking with OCR.
    - `type` string, required — File type: 'document' or 'base64;extension'
    - `content` string, required — Filename (for document) or base64 data
  - `ocr` string — OCR provider (mistral or gemini)
  - `tokenizer` string — Tokenizer to use
  - `chunk_size` integer — Size of each chunk
  - `chunk_overlap` integer — Overlap between chunks

## Response `200`

Successful Response

- unknown

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.dev/chonkie/apis/chonkie-api.md) · [All operations](https://skmtc.dev/chonkie/apis/chonkie-api/llms.txt) · [OpenAPI document](https://skmtc.dev/chonkie/apis/chonkie-api/revisions/f40f036f941c?raw)