---
title: "List Llm Models"
method: GET
path: "/v1/models/"
tags: ["models", "llms"]
---

# List Llm Models

`GET /v1/models/`

List available LLM models using the asynchronous implementation for improved performance

## Query parameters

- `provider_category` ProviderCategory[], nullable
- `provider_name` string, nullable
- `provider_type` 'anthropic' | 'azure' | 'bedrock' | 'cerebras' | 'deepseek' | 'google_ai' | 'google_vertex' | 'groq' | 'hugging-face' | 'letta' | 'lmstudio_openai' | 'mistral' | 'ollama' | 'openai' | 'together' | 'vllm' | 'xai'

## Response `200`

Successful Response

- LLMConfig[]
  - `model` string, required — LLM model name.
  - `model_endpoint_type` 'openai' | 'anthropic' | 'google_ai' | 'google_vertex' | 'azure' | 'groq' | 'ollama' | 'webui' | 'webui-legacy' | 'lmstudio' | 'lmstudio-legacy' | 'lmstudio-chatcompletions' | 'llamacpp' | 'koboldcpp' | 'vllm' | 'hugging-face' | 'mistral' | 'together' | 'bedrock' | 'deepseek' | 'xai', required — The endpoint type for the model.
  - `model_endpoint` string, nullable — The endpoint for the model.
  - `provider_name` string, nullable — The provider name for the model.
  - `provider_category` 'base' | 'byok'
  - `model_wrapper` string, nullable — The wrapper for the model.
  - `context_window` integer, required — The context window size for the model.
  - `put_inner_thoughts_in_kwargs` boolean, nullable — Puts 'inner_thoughts' as a kwarg in the function call if this is set to True. This helps with function calling performance and also the generation of inner thoughts.
  - `handle` string, nullable — The handle for this config, in the format provider/model-name.
  - `temperature` number — The temperature to use when generating text with the model. A higher temperature will result in more random text.
  - `max_tokens` integer, nullable — The maximum number of tokens to generate. If not set, the model will use its default value.
  - `enable_reasoner` boolean — Whether or not the model should use extended thinking if it is a 'reasoning' style model
  - `reasoning_effort` 'minimal' | 'low' | 'medium' | 'high', nullable — The reasoning effort to use when generating text reasoning models
  - `max_reasoning_tokens` integer — Configurable thinking budget for extended thinking. Used for enable_reasoner and also for Google Vertex models like Gemini 2.5 Flash. Minimum value is 1024 when used with enable_reasoner.
  - `frequency_penalty` number, nullable — Positive values penalize new tokens based on their existing frequency in the text so far, decreasing the model's likelihood to repeat the same line verbatim. From OpenAI: Number between -2.0 and 2.0.
  - `compatibility_type` 'gguf' | 'mlx', nullable — The framework compatibility type for the model.
  - `verbosity` 'low' | 'medium' | 'high', nullable — Soft control for how verbose model output should be, used for GPT-5 models.
  - `tier` string, nullable — The cost tier for the model (cloud only).

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.dev/yu-code666/apis/letta-api.md) · [All operations](https://skmtc.dev/yu-code666/apis/letta-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/yu-code666/letta-api/revisions/6cec99480c13/schema)