Shaping

Prepare a fine-tuned model for FP4 inference

Changed on

Prepares a fine-tuned model for FP4 inference: an adapter is merged into its base model and the result quantized to FP4; a full model is quantized as it is. The model is resolved when the request is made, so a request naming a model that does not exist in the project, was not produced by fine-tuning, has no base model, or uses an unsupported base model is rejected with 400 rather than accepted and failed later. The request names the model by model_object_id (the deprecated adapter_object_id is still accepted). The run is priced before it is created, and a project that cannot cover it is answered 402.

post/v1/shaping/prepare-for-fp4-inference

Request

  • Base URL
    https://api.together.ai
  • URL
    https://api.together.ai/v1/shaping/prepare-for-fp4-inference
  • Auth
    HTTP bearer

Request body

Example request

{
  "inputs": {
    "model_object_id": "ml_CeG3fF6pyEViU8dE8pk7R",
    "model_revision_id": "rv_CeG3faPBj2ABwbAaHPTmx",
    "calibration_file_id": "file-5f1b0c7a-2d19-4a3e-9c60-8ab41c2f7d35"
  }
}

Response

Quantization job created successfully.

idstring required

Unique shaping job ID.

job_type'quantization' required

Kind of shaping job.

status'pending' | 'queued' | 'running' | 'completed' | 'cancelled' | 'cancel_requested' | 'error' | 'user_error' required

Lifecycle status of a shaping job.

created_atstring date-time required

Time when the job was created.

updated_atstring date-time required

Time when the job was last updated.

user_idstring required

User that created the job.

Example response

{
  "params": {
    "inputs": {
      "model_object_id": "ml_CeG3fF6pyEViU8dE8pk7R",
      "model_revision_id": "rv_CeG3faPBj2ABwbAaHPTmx",
      "calibration_file_id": "file-5f1b0c7a-2d19-4a3e-9c60-8ab41c2f7d35"
    },
    "configuration": {
      "user_id": "user_CKfewYkQBpaEmN7wuQS3W",
      "model_project_id": "proj_CczF9KYFantA84sNYDTJd",
      "model_revision_id": "rv_CeERyXMBQCJTRC1yqGTpk",
      "model_name": "ft-qa-artifacts/glm-5.3-e2e-test-adapter",
      "base_object_id": "ml_CbJ9yCnij7A47b1xkpioB",
      "base_revision_id": "rv_CbJ9yNrws93VQrZum1fTE",
      "base_model_name": "zai-org/GLM-5.3-NVFP4"
    }
  }
}

Changes