---
title: "List Model Endpoints"
method: GET
path: "/v1/llm/model-endpoints"
---

# List Model Endpoints

`GET /v1/llm/model-endpoints`

Lists the LLM model endpoints owned by the current owner, plus all public_inference LLMs.

## Query parameters

- `name` string, nullable
- `order_by` 'newest' | 'oldest' | 'alphabetical' — The canonical list of possible orderings of Model Bundles.

## Response `200`

Successful Response

- ListLLMModelEndpointsV1Response
  - `model_endpoints` GetLLMModelEndpointV1Response[], required
    - `id` string, required
    - `name` string, required
    - `model_name` string, required
    - `source` 'hugging_face', required
    - `status` 'READY' | 'UPDATE_PENDING' | 'UPDATE_IN_PROGRESS' | 'UPDATE_FAILED' | 'DELETE_IN_PROGRESS', required
    - `inference_framework` 'deepspeed' | 'text_generation_inference' | 'vllm' | 'lightllm' | 'tensorrt_llm' | 'sglang', required
    - `inference_framework_image_tag` string, nullable
    - `num_shards` integer, nullable
    - `quantize` 'bitsandbytes' | 'awq'
    - `checkpoint_path` string, nullable
    - `chat_template_override` string, nullable — A Jinja template to use for this endpoint. If not provided, will use the chat template from the checkpoint
    - `task_expires_seconds` integer, nullable — For async endpoints, how long a task can wait in queue before expiring (in seconds).
    - `queue_message_timeout_seconds` integer, nullable — For async endpoints, the queue message visibility/lock timeout in seconds (SQS VisibilityTimeout / ASB lock_duration). Note: Azure Service Bus has a maximum of 300 seconds; values above this will be clamped.
    - `spec` GetModelEndpointV1Response — unresolved $ref

## Other responses

- `422` — Validation Error

---

[API](https://skmtc.dev/scaleapi/apis/launch.md) · [All operations](https://skmtc.dev/scaleapi/apis/launch/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/scaleapi/launch/revisions/8c9bf4700384/schema)