CHchutes
ConfigGuesser

Analyze Model

Changed on

Attempt to guess required GPU count and VRAM for a model on huggingface, assuming safetensors format.

get/guess/vllm_config

Request

  • Base URL
    https://api.chutes.ai (the document declares no server; this is the origin it was published from)
  • URL
    https://api.chutes.ai/guess/vllm_config
  • Auth
    none declared

Query parameters

modelstring required

Response

Successful Response

string required

Changes

  • 23e8895b217dRevision changes
    • breaking

      the response's body type changed from object to string for status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • breaking

      removed the required property from the response with the status

    • info

      added the optional property // to the response with the status

    • info

      added the optional property // to the response with the status

  • 8d909638091eRevision changes
    • info

      endpoint added