internal

Create Rate Limit Override

Create a new rate limit override for an org or user.

This endpoint requires internal API key authentication.

Example request:

{
  "identifier": "org:org_123",
  "endpointLimits": {
    "generation": {
      "maxTokens": 100,
      "refillRatePerSecond": 5.0
    },
    "status": {
      "maxTokens": 200,
      "refillRatePerSecond": 50.0
    }
  },
  "note": "Enterprise plan with higher limits"
}
post/internal/rate-limits/overrides

Headers

x-api-keystring required

Internal API Key for authentication

Internal API Key for authentication

Request body

identifierstring required

Identifier in format 'org:<id>' or 'user:<id>'

notestring

Optional note about why this override exists

Example request

{
  "identifier": "org:org_123"
}

Response

Successful Response

identifierstring required
createdAtstring date-time required
createdBystring required
updatedAtstring date-time nullable
updatedBystring nullable
notestring

Changes

Changed in 2 of the 13 revisions of this API.410

    • removed the request property endpointLimits/assetControl

      request-property-removed

    • removed the request property endpointLimits/assetIngress

      request-property-removed

    • removed the optional property endpointLimits/assetControl from the response with the 201 status

      response-optional-property-removed

    • removed the optional property endpointLimits/assetIngress from the response with the 201 status

      response-optional-property-removed

    This revision also has 18 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

    • added the new optional request property endpointLimits/assetControl

      new-optional-request-property

    • added the new optional request property endpointLimits/assetIngress

      new-optional-request-property

    • added the new optional request property endpointLimits/catalog

      new-optional-request-property

    • added the new optional request property endpointLimits/v2Create

      new-optional-request-property

    • added the new optional request property endpointLimits/v2Status

      new-optional-request-property

    • added the optional property endpointLimits/assetControl to the response with the 201 status

      response-optional-property-added

    • added the optional property endpointLimits/assetIngress to the response with the 201 status

      response-optional-property-added

    • added the optional property endpointLimits/catalog to the response with the 201 status

      response-optional-property-added

    • added the optional property endpointLimits/v2Create to the response with the 201 status

      response-optional-property-added

    • added the optional property endpointLimits/v2Status to the response with the 201 status

      response-optional-property-added