llm utils

Token Counter

Args: request: TokenCountRequest call_endpoint: bool - When set to "True" it will call the token counting endpoint - e.g Anthropic or Google AI Studio Token Counting APIs.

Returns: TokenCountResponse

post/utils/token_counter

Request

  • Base URL: https://api.aiaw.app (the document declares no server; this is the origin it was published from)
  • URL: https://api.aiaw.app/utils/token_counter
  • Auth: one of:
    • API key in header x-litellm-api-key
    • API key in header x-litellm-api-key
    • API key in header x-litellm-api-key
    • API key in header x-litellm-api-key
    • API key in header x-litellm-api-key
    • API key in header x-litellm-api-key

Query parameters

call_endpointboolean

Request body

modelstring required
promptstring nullable
messagesobject[] nullable
contentsobject[] nullable

Response

Successful Response

total_tokensinteger required
request_modelstring required
model_usedstring required
tokenizer_typestring required
original_responseobject nullable

Changes

No recorded changes to this operation across all 1 revision of this API.