GenAI Integration

Count tokens (Gemini format)

Counts tokens using Google Gemini API format.

post/genai/v1beta/models/{model}:countTokens

Request

Base URL
http://localhost:8080
Auth
- HTTP bearer
- or HTTP basic
- or API key in header x-bf-vk
- or API key in header x-api-key
TypeScript
https://skmtc.dev/getbifrost/apis/bifrost-api/docs/genai/v1beta/models/:model:countTokens/post.ts
A function with typed inputs. Its response is checked against the schema.

modelstring required

Model name with action (e.g., gemini-pro:countTokens)

Successful response

totalTokensinteger

Number of tokens that the model tokenizes the prompt into

cachedContentTokenCountinteger

Number of tokens in the cached part of the prompt

No recorded changes to this operation across all 1 revision of this API.