Sign in
DeploymentService

Update a deployment

Updates mutable deployment fields such as its model, configuration, autoscaling bounds, or LoRA support. Changes that affect serving may trigger asynchronous reprovisioning.

patch/projects/{projectId}/endpoints/{endpointId}/deployments/{id}

Path parameters

projectIdstring required

Project identifier.

endpointIdstring required

Endpoint identifier.

idstring required

Deployment identifier.

Query parameters

updateMaskstring

Fields to update. If not set, the fields populated on deployment are updated.

Request body

namestring

Updated endpoint string.

etagstring

Current deployment version. The update is rejected if this value no longer matches.

Response

OK

idstring required

Unique deployment identifier.

projectIdstring required

ID of the project that owns the deployment.

endpointIdstring required

ID of the endpoint that contains the deployment.

namestring required

Project- and endpoint-qualified deployment name in the form <project_slug>/<endpoint_name>/<deployment_name>. Pass it as model in an inference request to target this deployment directly instead of using the endpoint's traffic split.

createdAtstring date-time required

Timestamp when the deployment was created.

updatedAtstring date-time required

Timestamp when the deployment was last updated.

modelIdstring required

Deprecated. Use model. Model identifier being served, populated during migration.

modelRevisionIdstring required

Deprecated. Use model with a /revisions/{revisionId} segment. Pin to a specific model revision.

modelstring required

Pinned model resource in the form projects/{projectId}/models/{modelId}/revisions/{revisionId}.

configIdstring required

Deprecated. Use config. Config revision identifier, populated during migration.

configstring required

Immutable config revision in the form projects/{projectId}/configs/{configRevisionId}.

speculatorIdstring

Deprecated. Use speculator. Speculative decoding model identifier derived from the deployment config.

speculatorRevisionIdstring

Deprecated. Use speculator. ID of the speculative decoding draft-model revision pinned at creation time.

speculatorstring

Pinned draft-model resource used for speculative decoding, in the same form as model. Omitted when speculative decoding is disabled.

estimatedEffectiveTrafficSharenumber double

Estimated fraction in [0, 1] of endpoint traffic that reaches this deployment under the current routing configuration. Absent or unrouted deployments are 0.

enableLoraboolean

Whether the deployment can dynamically load LoRA adapters.

etagstring required

Opaque version tag for optimistic concurrency control. Supply on update/delete to ensure consistent read-modify-write. If not set, the write overwrites based on current state.

hardwarestring required

Hardware selected by the deployment config, including GPU type and count.

trafficMode'TRAFFIC_MODE_LIVE' | 'TRAFFIC_MODE_SHADOW' required

Whether the deployment serves client-visible responses or only mirrored shadow traffic.

desiredReplicasinteger

Number of replicas the autoscaler currently wants across all regions.

Changes

Changed in 1 of the 14 revisions of this API.1