Cache
Query Cache
Generate a completion using a pre-populated cache.
Args: name: Name of the cache to query. query: Prompt text to send to the model. max_tokens: Optional maximum number of tokens to generate. temperature: Optional sampling temperature for the model. auth: Authentication context for permission checks.
Returns: A :class:CompletionResponse object containing the model output.
post/cache/{name}/query
Path parameters
namestring required
Query parameters
querystring required
max_tokensinteger nullable
temperaturenumber nullable
Headers
authorizationstring
Response
Successful Response