internal

Create Rate Limit Override

Create a new rate limit override for an org or user.

This endpoint requires internal API key authentication.

Example request:

{
  "identifier": "org:org_123",
  "endpointLimits": {
    "generation": {
      "maxTokens": 100,
      "refillRatePerSecond": 5.0
    },
    "status": {
      "maxTokens": 200,
      "refillRatePerSecond": 50.0
    }
  },
  "note": "Enterprise plan with higher limits"
}
post/internal/rate-limits/overrides

Headers

x-api-keystring required

Internal API Key for authentication

Internal API Key for authentication

Request body

identifierstring required

Identifier in format 'org:<id>' or 'user:<id>'

notestring

Optional note about why this override exists

Example request

{
  "identifier": "org:org_123"
}

Response

Successful Response

identifierstring required
createdAtstring date-time required
createdBystring required
updatedAtstring date-time nullable
updatedBystring nullable
notestring

Changes

Changed in 2 of the 14 revisions of this API.410

    • ●

      removed the request property /

      request-property-removed

    • ●

      removed the request property /

      request-property-removed

    • ●

      removed the optional property / from the response with the status

      response-optional-property-removed

    • ●

      removed the optional property / from the response with the status

      response-optional-property-removed

    This revision also has 18 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog

    • ○

      added the new optional request property /

      new-optional-request-property

    • ○

      added the new optional request property /

      new-optional-request-property

    • ○

      added the new optional request property /

      new-optional-request-property

    • ○

      added the new optional request property /

      new-optional-request-property

    • ○

      added the new optional request property /

      new-optional-request-property

    • ○

      added the optional property / to the response with the status

      response-optional-property-added

    • ○

      added the optional property / to the response with the status

      response-optional-property-added

    • ○

      added the optional property / to the response with the status

      response-optional-property-added

    • ○

      added the optional property / to the response with the status

      response-optional-property-added

    • ○

      added the optional property / to the response with the status

      response-optional-property-added