---
title: "Changes to Token Chunker"
method: POST
path: "/v1/chunk/token"
---

# Changes to Token Chunker

`POST /v1/chunk/token`

> Every recorded change to this endpoint, newest first.

## Timeline

Changed in 10 of 20 revisions.

- **2025-05-04** `33dc37e4abcd` — 1 info
- **2025-04-27** `bc64e1775952` — 1 info
- **2025-04-27** `5c8e44804806` — 1 breaking
- **2025-04-27** `7e3cb743a9ed` — 1 warning
- **2025-04-22** `b5fe83cf70c6` — 1 breaking, 1 info
- **2025-04-06** `502b267e607d` — 1 breaking, 2 info
- **2025-04-06** `2d174e4e5a5a` — 4 info
- **2025-04-06** `a9d5b6b90675` — 4 breaking, 1 warning, 4 info
- **2025-04-06** `678e90630336` — 3 info
- **2025-04-06** `c791be50601b` — 2 breaking, 4 warning, 3 info

## Changes

- **2025-05-04** `33dc37e4abcd` — 1 info
  - added the optional property `items/context` to the response with the `200` status
- **2025-04-27** `bc64e1775952` — 1 info
  - endpoint added
- **2025-04-27** `5c8e44804806` — 1 breaking
  - api removed without deprecation
- **2025-04-27** `7e3cb743a9ed` — 1 warning
  - removed the request property `text`
- **2025-04-22** `b5fe83cf70c6` — 1 breaking, 1 info
  - removed the media type `application/json` from the request body
  - added the media type `multipart/form-data` to the request body
- **2025-04-06** `502b267e607d` — 1 breaking, 2 info
  - request property `return_type` was restricted to a list of enum values
  - added the new `chunks` enum value to the request property `return_type`
  - added the new `texts` enum value to the request property `return_type`
- **2025-04-06** `2d174e4e5a5a` — 4 info
  - the request property `chunk_overlap` became optional
  - the request property `chunk_size` became optional
  - the request property `return_type` became optional
  - the request property `tokenizer` became optional
- **2025-04-06** `a9d5b6b90675` — 4 breaking, 1 warning, 4 info
  - the response property `items/end_index` became optional for the status `200`
  - the response property `items/start_index` became optional for the status `200`
  - the response property `items/text` became optional for the status `200`
  - the response property `items/token_count` became optional for the status `200`
  - removed the request property `args`
  - added the new required request property `chunk_overlap` with a default value
  - added the new required request property `chunk_size` with a default value
  - added the new required request property `return_type` with a default value
  - added the new required request property `tokenizer` with a default value
- **2025-04-06** `678e90630336` — 3 info
  - removed the non-success response with the status `401`
  - removed the non-success response with the status `422`
  - removed the non-success response with the status `500`
- **2025-04-06** `c791be50601b` — 2 breaking, 4 warning, 3 info
  - added the new required request property `args`
  - the response's body type/format changed from ``/`` to `array`/`` for status `200`
  - removed the request property `chunk_overlap`
  - removed the request property `chunk_size`
  - removed the request property `return_type`
  - removed the request property `tokenizer`
  - removed `#/components/schemas/ErrorRES, subschema #1, subschema #2, subschema #3, subschema #4` from the response body `anyOf` list for the response status `200`
  - added the non-success response with the status `401`
  - added the non-success response with the status `500`

---

[Operation](https://skmtc.dev/feyninc/apis/chonkie-api/docs/v1/chunk/token/post.md) · [API](https://skmtc.dev/feyninc/apis/chonkie-api.md) · [Page](https://skmtc.dev/feyninc/apis/chonkie-api/changes/v1/chunk/token/post)