Sign in
DeploymentService

Create a deployment

Creates a model deployment under an endpoint. The deployment provisions asynchronously; monitor its status before routing live traffic to it.

post/projects/{projectId}/endpoints/{endpointId}/deployments

Path parameters

projectIdstring required

ID of the project that owns the endpoint.

endpointIdstring required

ID of the endpoint that will contain the deployment.

Query parameters

validateOnlyboolean

When true, validates the request without creating or provisioning a deployment.

Request body

namestring required

Name for the deployment within its endpoint. Returned as a fully-qualified endpoint string.

modelIdstring

Deprecated. Use model. Model identifier to serve, accepted when model is unset.

modelRevisionIdstring

Deprecated. Use model with a /revisions/{revisionId} segment. If omitted, the latest revision is resolved at creation.

configIdstring

Deprecated. Use config. Config revision identifier to deploy, accepted when config is unset.

modelstring

Model resource name in the form projects/{projectId}/models/{modelId}[/revisions/{revisionId}]. Omit the revision segment to pin the latest revision at creation time.

configstring

Immutable config revision in the form projects/{projectId}/configs/{configRevisionId}. The config must be compatible with the model.

enableLoraboolean

Enables dynamic loading of LoRA adapters on the deployment.

Response

OK

idstring required

Unique deployment identifier.

projectIdstring required

ID of the project that owns the deployment.

endpointIdstring required

ID of the endpoint that contains the deployment.

namestring required

Project- and endpoint-qualified deployment name in the form <project_slug>/<endpoint_name>/<deployment_name>. Pass it as model in an inference request to target this deployment directly instead of using the endpoint's traffic split.

createdAtstring date-time required

Timestamp when the deployment was created.

updatedAtstring date-time required

Timestamp when the deployment was last updated.

modelIdstring required

Deprecated. Use model. Model identifier being served, populated during migration.

modelRevisionIdstring required

Deprecated. Use model with a /revisions/{revisionId} segment. Pin to a specific model revision.

modelstring required

Pinned model resource in the form projects/{projectId}/models/{modelId}/revisions/{revisionId}.

configIdstring required

Deprecated. Use config. Config revision identifier, populated during migration.

configstring required

Immutable config revision in the form projects/{projectId}/configs/{configRevisionId}.

speculatorIdstring

Deprecated. Use speculator. Speculative decoding model identifier derived from the deployment config.

speculatorRevisionIdstring

Deprecated. Use speculator. ID of the speculative decoding draft-model revision pinned at creation time.

speculatorstring

Pinned draft-model resource used for speculative decoding, in the same form as model. Omitted when speculative decoding is disabled.

estimatedEffectiveTrafficSharenumber double

Estimated fraction in [0, 1] of endpoint traffic that reaches this deployment under the current routing configuration. Absent or unrouted deployments are 0.

enableLoraboolean

Whether the deployment can dynamically load LoRA adapters.

etagstring required

Opaque version tag for optimistic concurrency control. Supply on update/delete to ensure consistent read-modify-write. If not set, the write overwrites based on current state.

hardwarestring required

Hardware selected by the deployment config, including GPU type and count.

trafficMode'TRAFFIC_MODE_LIVE' | 'TRAFFIC_MODE_SHADOW' required

Whether the deployment serves client-visible responses or only mirrored shadow traffic.

desiredReplicasinteger

Number of replicas the autoscaler currently wants across all regions.

Changes

Changed in 1 of the 14 revisions of this API.1