ai

LLM Throughput & GPU Sizing Calculator

Estimate how many GPUs your LLM needs: concurrent users and target tokens per second become cluster size, monthly cloud cost, and real utilization at load.

post/api/v1/tools/llm-throughput-calculator

Request

  • Base URL: https://calcfleet.com
  • URL: https://calcfleet.com/api/v1/tools/llm-throughput-calculator
  • Auth: none declared

Request body

concurrentUsersinteger required
targetTokensPerSecPerUsernumber required
gpuId'h100-sxm-80gb' | 'a100-sxm-80gb' | 'a100-40gb' | 'l40s-48gb' | 'rtx-4090-24gb' required
gpuHourlyUsdnumber required
aggregateTokensPerSecPerGpunumber required
utilizationHeadroomPctnumber required

Response

Successful calculation result.

resultobject required

Structured calculation output (fields vary per calculator).

Changes

No recorded changes to this operation across all 1 revision of this API.