AI Gateway

List AI Gateway rate limit counter summaries

Changed on

Aggregate the counters of every template rate limit in the organization in one call, with one summary per template in the order the rate limit list returns them. Each summary is the one the single-template counter summary endpoint returns without split_dim, including scope_restricted and truncated. Rate limits with one shared allowance are left out. Summaries are cached for up to 15 seconds.

get/api/v2/rate-limits/instances/summary

Request

  • Base URL
    https://api.datadoghq.com
  • Auth
    • API key in header DD-API-KEY and API key in header DD-APPLICATION-KEY
    • or OAuth 2
      Authorization code/oauth2/v1/authorize
      Token URL/oauth2/v1/token
      Scopesai_gateway_config_read

Response

OK

Example response

{
  "data": [
    {
      "attributes": {
        "instance_count": 14,
        "limited_requests": 25,
        "limiting_count": 2,
        "max_utilization": 1.2,
        "near_limit_count": 3,
        "rate_limit_id": "33333333-3333-3333-3333-333333333333"
      },
      "id": "33333333-3333-3333-3333-333333333333",
      "type": "rate-limit-instances-summary"
    }
  ]
}

Changes