gateway.openapi_Gateway

Prepare Model for different precisions

post/v1/accounts/{account_id}/models/{model_id}:prepare

Request

  • Base URL: https://api.fireworks.ai
  • URL: https://api.fireworks.ai/v1/accounts/{account_id}/models/{model_id}:prepare
  • Auth: HTTP bearer

Path parameters

account_idstring required

The Account Id

model_idstring required

The Model Id

Request body

precision'PRECISION_UNSPECIFIED' | 'FP16' | 'FP8' | 'FP8_MM' | 'FP8_AR' | 'FP8_MM_KV_ATTN' | 'FP8_KV' | 'FP8_MM_V2' | 'FP8_V2' | 'FP8_MM_KV_ATTN_V2' | 'NF4' | 'FP4' | 'BF16' | 'FP4_BLOCKSCALED_MM' | 'FP4_MX_MOE'
readMaskstring
acceleratorCountinteger

Number of accelerators (GPUs) to use for quantization. Defaults to 8 if unset.

abortboolean

If true, abort an active prepare job and clear prepare tracking state. No new prepare job is launched in this request.

Response

A successful response.

object required

Changes

No recorded changes to this operation across all 1 revision of this API.