AI Gateway
List AI Gateway rate limit counter summaries
Changed onAggregate the counters of every template rate limit in the organization in one call, with one summary per template in the order the rate limit list returns them. Each summary is the one the single-template counter summary endpoint returns without split_dim, including scope_restricted and truncated. Rate limits with one shared allowance are left out. Summaries are cached for up to 15 seconds.
get/api/v2/rate-limits/instances/summary
Request
- Base URLhttps://api.datadoghq.com
- Auth
- API key in header DD-API-KEY and API key in header DD-APPLICATION-KEY
- or OAuth 2Authorization code/oauth2/v1/authorizeToken URL/oauth2/v1/tokenScopesai_gateway_config_read
Response
OK
Example response
{
"data": [
{
"attributes": {
"instance_count": 14,
"limited_requests": 25,
"limiting_count": 2,
"max_utilization": 1.2,
"near_limit_count": 3,
"rate_limit_id": "33333333-3333-3333-3333-333333333333"
},
"id": "33333333-3333-3333-3333-333333333333",
"type": "rate-limit-instances-summary"
}
]
}Changes
- info
endpoint added
- info