Sign in
llm utils

Token Counter

Args: request: TokenCountRequest call_endpoint: bool - When set to "True" it will call the token counting endpoint - e.g Anthropic or Google AI Studio Token Counting APIs.

Returns: TokenCountResponse

post/utils/token_counter

Query parameters

call_endpointboolean

Request body

modelstring required
promptstring nullable
messagesobject[] nullable
contentsobject[] nullable

Response

Successful Response

total_tokensinteger required
request_modelstring required
model_usedstring required
tokenizer_typestring required
original_responseobject nullable
errorboolean
error_messagestring nullable
status_codeinteger nullable

Changes

No recorded changes to this endpoint across all 1 revision of this API.