models

List MaaS Models

Lists available large language models in OpenAI-compatible format. Incoming HTTP headers on this request are forwarded to the upstream MaaS API unchanged (aside from Content-Type and Authorization, which the BFF sets for the outbound call). Callers may send headers understood by maas-api (for example X-MaaS-Return-All-Models).

get/api/v1/models

Response

List of models

Example response

{
  "data": {
    "object": "list",
    "data": [
      {
        "created": 1672531200,
        "id": "llama-2-7b-chat",
        "object": "model",
        "owned_by": "model-namespace/llama-2-7b-chat",
        "ready": true,
        "url": "https://api.example.com/v1/models/llama-2-7b-chat",
        "modelDetails": {
          "displayName": "Llama 2 7B Chat",
          "description": "A large language model optimized for chat use cases",
          "genaiUseCase": "chat",
          "contextWindow": "4096"
        },
        "kind": "LLMInferenceService",
        "subscriptions": [
          {
            "name": "premium-subscription",
            "displayName": "Premium Subscription",
            "description": "Premium subscription with higher rate limits"
          }
        ]
      }
    ]
  }
}

Changes

Changed in 5 of the 31 revisions of this API.711

    • added the optional property data/data/items/modelDetails/modelCapabilities to the response with the 200 status

      response-optional-property-added

    • the data response's property type/format changed from array/ to object/ for status 200

      response-property-type-changed

    • removed the required property object from the response with the 200 status

      response-required-property-removed

    • added the required property data/data to the response with the 200 status

      response-required-property-added

    • added the required property data/object to the response with the 200 status

      response-required-property-added

    • added the optional property data/items/kind to the response with the 200 status

      response-optional-property-added

    • added the optional property data/items/modelDetails to the response with the 200 status

      response-optional-property-added

    • added the optional property data/items/subscriptions to the response with the 200 status

      response-optional-property-added

    • api tag models added

      api-tag-added

    • added the media type application/json for the response with the status 500

      response-media-type-added

    • the response property data became required for the status 200

      response-property-became-required

    • added the required property object to the response with the 200 status

      response-required-property-added

    This revision also has 7 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

    • removed the media type application/json for the response with the status 500

      response-media-type-removed

    • the response property data became optional for the status 200

      response-property-became-optional

    • the data response's property type/format changed from object/ to array/ for status 200

      response-property-type-changed

    • removed the required property data/data from the response with the 200 status

      response-required-property-removed

    • removed the required property data/object from the response with the 200 status

      response-required-property-removed

    • api tag models removed

      api-tag-removed

    This revision also has 41 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog