Tokenization

By giving a text input, generate a tokenized output of token IDs.

post/v1/tokenize

Request

Base URL
http://localhost:8000
Auth
none declared
TypeScript
https://skmtc.dev/friendli/apis/friendli-suite-api-reference/docs/v1/tokenize/post.ts
A function with typed inputs. Its response is checked against the schema.

modelstring nullable

Routes the request to a specific adapter.

promptstring required

Input text prompt to tokenize.

{
  "prompt": "What is generative AI?"
}

Successfully tokenized the text.

tokensinteger[] required

A list of token IDs.

No recorded changes to this operation across all 1 revision of this API.