Tokenizer

Tokenize

Changed on
post/v1/tokenize

Request

  • Base URL: https://api.deepinfra.com
  • URL: https://api.deepinfra.com/v1/tokenize
  • Auth: HTTP bearer

Headers

xi-api-keystring nullable
x-api-keystring nullable

Request body

modelstring required

model name

promptstring nullable

text to tokenize (completion form)

messagesobject[] nullable

chat messages to tokenize (chat form)

return_token_strsboolean nullable

also return the per-token strings (vLLM)

Example request

{
  "model": "my-org/my-dedicated-llm"
}

Response

Successful Response

countinteger required

number of tokens

max_model_leninteger required

the model's maximum context length

tokensinteger[] required

token ids

token_strsstring[] nullable

per-token strings, if requested (vLLM)

Changes