---
title: "Changes to Tokenize inputs"
method: POST
path: "/tokenize"
---

# Changes to Tokenize inputs

`POST /tokenize`

> Every recorded change to this operation, newest first.

## Timeline

Changed in 5 of 44 revisions.

- **2025-09-01** `9988d0e89620`: 1 warning, 2 info
- **2024-06-28** `b923798e3868`: 1 info
- **2024-03-22** `36fa20faa0bb`: 2 breaking, 1 info
- **2024-01-26** `51015074a126`: 1 info
- **2023-10-13** `8c00768ef703`: 1 breaking

## Changes

- **2025-09-01** `9988d0e89620`: 1 warning, 2 info
  - added the new `Empty` enum value to the `error_type` response property for the response status `422`
  - added the non-success response with the status `400`
  - added the non-success response with the status `413`
- **2024-06-28** `b923798e3868`: 1 info
  - added the new optional request property `prompt_name`
- **2024-03-22** `36fa20faa0bb`: 2 breaking, 1 info
  - removed the required property `code` from the response with the `422` status
  - removed the required property `message` from the response with the `422` status
  - added the required property `error` to the response with the `422` status
- **2024-01-26** `51015074a126`: 1 info
  - endpoint added
- **2023-10-13** `8c00768ef703`: 1 breaking
  - api path removed without deprecation

---

[Operation](https://skmtc.dev/huggingface/apis/text-embeddings-inference/docs/tokenize/post.md) - [API](https://skmtc.dev/huggingface/apis/text-embeddings-inference.md) - [Page](https://skmtc.dev/huggingface/apis/text-embeddings-inference/changes/tokenize/post)