--- title: "GET /v1/publishers/{publishersId}/models/{modelsId}" method: GET path: "/v1/publishers/{publishersId}/models/{modelsId}" tags: ["publishers"] --- # GET /v1/publishers/{publishersId}/models/{modelsId} `GET /v1/publishers/{publishersId}/models/{modelsId}` ## Request - Base URL: `https://aiplatform.googleapis.com` - URL: `https://aiplatform.googleapis.com/v1/publishers/{publishersId}/models/{modelsId}` - Auth: one of: - OAuth 2 and OAuth 2 - Implicit: `https://accounts.google.com/o/oauth2/auth` - Scopes: `https://www.googleapis.com/auth/aiplatform` - Authorization code: `https://accounts.google.com/o/oauth2/auth` - Token URL: `https://accounts.google.com/o/oauth2/token` scopes: `https://www.googleapis.com/auth/aiplatform` - OAuth 2 and OAuth 2 - Implicit: `https://accounts.google.com/o/oauth2/auth` - Scopes: `https://www.googleapis.com/auth/cloud-platform` - Authorization code: `https://accounts.google.com/o/oauth2/auth` - Token URL: `https://accounts.google.com/o/oauth2/token` scopes: `https://www.googleapis.com/auth/cloud-platform` Gets a Model Garden publisher model. ## Path parameters - `publishersId` string, required - `modelsId` string, required ## Query parameters - `huggingFaceToken` string - `isHuggingFaceModel` boolean - `languageCode` string - `view` 'PUBLISHER_MODEL_VIEW_UNSPECIFIED' | 'PUBLISHER_MODEL_VIEW_BASIC' | 'PUBLISHER_MODEL_VIEW_FULL' | 'PUBLISHER_MODEL_VERSION_VIEW_BASIC' ## Response `200` Successful response - GoogleCloudAiplatformV1PublisherModel: A Model Garden Publisher Model. - `frameworks` string[]: Optional. Additional information about the model's Frameworks. - `launchStage` 'LAUNCH_STAGE_UNSPECIFIED' | 'EXPERIMENTAL' | 'PRIVATE_PREVIEW' | 'PUBLIC_PREVIEW' | 'GA': Optional. Indicates the launch stage of the model. - `name` string: Output only. Identifier. The resource name of the PublisherModel. - `openSourceCategory` 'OPEN_SOURCE_CATEGORY_UNSPECIFIED' | 'PROPRIETARY' | 'GOOGLE_OWNED_OSS_WITH_GOOGLE_CHECKPOINT' | 'THIRD_PARTY_OWNED_OSS_WITH_GOOGLE_CHECKPOINT' | 'GOOGLE_OWNED_OSS' | 'THIRD_PARTY_OWNED_OSS': Required. Indicates the open source category of the publisher model. - `predictSchemata` GoogleCloudAiplatformV1PredictSchemata: Contains the schemata used in Model's predictions and explanations via PredictionService.Predict, PredictionService.Explain and BatchPredictionJob. - `instanceSchemaUri` string: Immutable. Points to a YAML file stored on Google Cloud Storage describing the format of a single instance, which are used in PredictRequest.instances, ExplainRequest.instances and BatchPredictionJob.input_config. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). AutoML Models always have this field populated by Vertex AI. Note: The URI given on output will be immutable and probably different, including the URI scheme, than the one given on input. The output URI will point to a location where the user only has a read access. - `parametersSchemaUri` string: Immutable. Points to a YAML file stored on Google Cloud Storage describing the parameters of prediction and explanation via PredictRequest.parameters, ExplainRequest.parameters and BatchPredictionJob.model_parameters. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). AutoML Models always have this field populated by Vertex AI, if no parameters are supported, then it is set to an empty string. Note: The URI given on output will be immutable and probably different, including the URI scheme, than the one given on input. The output URI will point to a location where the user only has a read access. - `predictionSchemaUri` string: Immutable. Points to a YAML file stored on Google Cloud Storage describing the format of a single prediction produced by this Model, which are returned via PredictResponse.predictions, ExplainResponse.explanations, and BatchPredictionJob.output_config. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). AutoML Models always have this field populated by Vertex AI. Note: The URI given on output will be immutable and probably different, including the URI scheme, than the one given on input. The output URI will point to a location where the user only has a read access. - `publisherModelTemplate` string: Optional. Output only. Immutable. Used to indicate this model has a publisher model and provide the template of the publisher model resource name. - `supportedActions` GoogleCloudAiplatformV1PublisherModelCallToAction: Actions could take on this Publisher Model. - `createApplication` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `deploy` GoogleCloudAiplatformV1PublisherModelCallToActionDeploy: Model metadata that is needed for UploadModel or DeployModel/CreateEndpoint requests. - `artifactUri` string: Optional. The path to the directory containing the Model artifact and any of its supporting files. - `automaticResources` GoogleCloudAiplatformV1AutomaticResources: A description of resources that to large degree are decided by Agent Platform, and require only a modest additional configuration. Each Model supporting these resources documents its specific guidelines. - `maxReplicaCount` integer: Immutable. The maximum number of replicas that may be deployed on when the traffic against it increases. If the requested value is too large, the deployment will error, but if deployment succeeds then the ability to scale to that many replicas is guaranteed (barring service outages). If traffic increases beyond what its replicas at maximum may handle, a portion of the traffic will be dropped. If this value is not provided, a no upper bound for scaling under heavy traffic will be assume, though Agent Platform may be unable to scale beyond certain replica number. - `minReplicaCount` integer: Immutable. The minimum number of replicas that will be always deployed on. If traffic against it increases, it may dynamically be deployed onto more replicas up to max_replica_count, and as traffic decreases, some of these extra replicas may be freed. If the requested value is too large, the deployment will error. - `containerSpec` GoogleCloudAiplatformV1ModelContainerSpec: Specification of a container for serving predictions. Some fields in this message correspond to fields in the [Kubernetes Container v1 core specification](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `args` string[]: Immutable. Specifies arguments for the command that runs when the container starts. This overrides the container's [`CMD`](https://docs.docker.com/engine/reference/builder/#cmd). Specify this field as an array of executable and arguments, similar to a Docker `CMD`'s "default parameters" form. If you don't specify this field but do specify the command field, then the command from the `command` field runs without any additional arguments. See the [Kubernetes documentation about how the `command` and `args` fields interact with a container's `ENTRYPOINT` and `CMD`](https://kubernetes.io/docs/tasks/inject-data-application/define-command-argument-container/#notes). If you don't specify this field and don't specify the `command` field, then the container's [`ENTRYPOINT`](https://docs.docker.com/engine/reference/builder/#cmd) and `CMD` determine what runs based on their default behavior. See the Docker documentation about [how `CMD` and `ENTRYPOINT` interact](https://docs.docker.com/engine/reference/builder/#understand-how-cmd-and-entrypoint-interact). In this field, you can reference [environment variables set by Vertex AI](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables) and environment variables set in the env field. You cannot reference environment variables set in the Docker image. In order for environment variables to be expanded, reference them by using the following syntax: $( VARIABLE_NAME) Note that this differs from Bash variable expansion, which does not use parentheses. If a variable cannot be resolved, the reference in the input string is used unchanged. To avoid variable expansion, you can escape this syntax with `$$`; for example: $$(VARIABLE_NAME) This field corresponds to the `args` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `command` string[]: Immutable. Specifies the command that runs when the container starts. This overrides the container's [ENTRYPOINT](https://docs.docker.com/engine/reference/builder/#entrypoint). Specify this field as an array of executable and arguments, similar to a Docker `ENTRYPOINT`'s "exec" form, not its "shell" form. If you do not specify this field, then the container's `ENTRYPOINT` runs, in conjunction with the args field or the container's [`CMD`](https://docs.docker.com/engine/reference/builder/#cmd), if either exists. If this field is not specified and the container does not have an `ENTRYPOINT`, then refer to the Docker documentation about [how `CMD` and `ENTRYPOINT` interact](https://docs.docker.com/engine/reference/builder/#understand-how-cmd-and-entrypoint-interact). If you specify this field, then you can also specify the `args` field to provide additional arguments for this command. However, if you specify this field, then the container's `CMD` is ignored. See the [Kubernetes documentation about how the `command` and `args` fields interact with a container's `ENTRYPOINT` and `CMD`](https://kubernetes.io/docs/tasks/inject-data-application/define-command-argument-container/#notes). In this field, you can reference [environment variables set by Vertex AI](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables) and environment variables set in the env field. You cannot reference environment variables set in the Docker image. In order for environment variables to be expanded, reference them by using the following syntax: $( VARIABLE_NAME) Note that this differs from Bash variable expansion, which does not use parentheses. If a variable cannot be resolved, the reference in the input string is used unchanged. To avoid variable expansion, you can escape this syntax with `$$`; for example: $$(VARIABLE_NAME) This field corresponds to the `command` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `deploymentTimeout` string, google-duration: Immutable. Deployment timeout. Limit for deployment timeout is 2 hours. - `env` GoogleCloudAiplatformV1EnvVar[]: Immutable. List of environment variables to set in the container. After the container starts running, code running in the container can read these environment variables. Additionally, the command and args fields can reference these variables. Later entries in this list can also reference earlier entries. For example, the following example sets the variable `VAR_2` to have the value `foo bar`: ```json [ { "name": "VAR_1", "value": "foo" }, { "name": "VAR_2", "value": "$(VAR_1) bar" } ] ``` If you switch the order of the variables in the example, then the expansion does not occur. This field corresponds to the `env` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). At most 200 environment variables can be specified. Each variable (`NAME=value`) must be smaller than 128 KiB, and the total size of all variables must not exceed 512 KiB. - `name` string: Required. Name of the environment variable. Must be a valid C identifier. - `value` string: Required. Variables that reference a $(VAR_NAME) are expanded using the previous defined environment variables in the container and any service environment variables. If a variable cannot be resolved, the reference in the input string will be unchanged. The $(VAR_NAME) syntax can be escaped with a double $$, ie: $$(VAR_NAME). Escaped references will never be expanded, regardless of whether the variable exists or not. - `grpcPorts` GoogleCloudAiplatformV1Port[]: Immutable. List of ports to expose from the container. Vertex AI sends gRPC prediction requests that it receives to the first port on this list. Vertex AI also sends liveness and health checks to this port. If you do not specify this field, gRPC requests to the container will be disabled. Vertex AI does not use ports other than the first one listed. This field corresponds to the `ports` field of the Kubernetes Containers v1 core API. - `containerPort` integer: The number of the port to expose on the pod's IP address. Must be a valid port number, between 1 and 65535 inclusive. - `healthProbe` GoogleCloudAiplatformV1Probe: Probe describes a health check to be performed against a container to determine whether it is alive or ready to receive traffic. - `exec` GoogleCloudAiplatformV1ProbeExecAction: ExecAction specifies a command to execute. - `command` string[]: Command is the command line to execute inside the container, the working directory for the command is root ('/') in the container's filesystem. The command is simply exec'd, it is not run inside a shell, so traditional shell instructions ('|', etc) won't work. To use a shell, you need to explicitly call out to that shell. Exit status of 0 is treated as live/healthy and non-zero is unhealthy. - `failureThreshold` integer: Number of consecutive failures before the probe is considered failed. Defaults to 3. Minimum value is 1. Maps to Kubernetes probe argument 'failureThreshold'. - `grpc` GoogleCloudAiplatformV1ProbeGrpcAction: GrpcAction checks the health of a container using a gRPC service. - `port` integer: Port number of the gRPC service. Number must be in the range 1 to 65535. - `service` string: Service is the name of the service to place in the gRPC HealthCheckRequest. See https://github.com/grpc/grpc/blob/master/doc/health-checking.md. If this is not specified, the default behavior is defined by gRPC. - `httpGet` GoogleCloudAiplatformV1ProbeHttpGetAction: HttpGetAction describes an action based on HTTP Get requests. - `host` string: Host name to connect to, defaults to the model serving container's IP. You probably want to set "Host" in httpHeaders instead. - `httpHeaders` GoogleCloudAiplatformV1ProbeHttpHeader[]: Custom headers to set in the request. HTTP allows repeated headers. - … - `path` string: Path to access on the HTTP server. - `port` integer: Number of the port to access on the container. Number must be in the range 1 to 65535. - `scheme` string: Scheme to use for connecting to the host. Defaults to HTTP. Acceptable values are "HTTP" or "HTTPS". - `initialDelaySeconds` integer: Number of seconds to wait before starting the probe. Defaults to 0. Minimum value is 0. Maps to Kubernetes probe argument 'initialDelaySeconds'. - `periodSeconds` integer: How often (in seconds) to perform the probe. Default to 10 seconds. Minimum value is 1. Must be less than timeout_seconds. Maps to Kubernetes probe argument 'periodSeconds'. - `successThreshold` integer: Number of consecutive successes before the probe is considered successful. Defaults to 1. Minimum value is 1. Maps to Kubernetes probe argument 'successThreshold'. - `tcpSocket` GoogleCloudAiplatformV1ProbeTcpSocketAction: TcpSocketAction probes the health of a container by opening a TCP socket connection. - `host` string: Optional: Host name to connect to, defaults to the model serving container's IP. - `port` integer: Number of the port to access on the container. Number must be in the range 1 to 65535. - `timeoutSeconds` integer: Number of seconds after which the probe times out. Defaults to 1 second. Minimum value is 1. Must be greater or equal to period_seconds. Maps to Kubernetes probe argument 'timeoutSeconds'. - `healthRoute` string: Immutable. HTTP path on the container to send health checks to. Vertex AI intermittently sends GET requests to this path on the container's IP address and port to check that the container is healthy. Read more about [health checks](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#health). For example, if you set this field to `/bar`, then Vertex AI intermittently sends a GET request to the `/bar` path on the port of your container specified by the first value of this `ModelContainerSpec`'s ports field. If you don't specify this field, it defaults to the following value when you deploy this Model to an Endpoint: /v1/endpoints/ENDPOINT/deployedModels/ DEPLOYED_MODEL:predict The placeholders in this value are replaced as follows: * ENDPOINT: The last segment (following `endpoints/`)of the Endpoint.name][] field of the Endpoint where this Model has been deployed. (Vertex AI makes this value available to your container code as the [`AIP_ENDPOINT_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) * DEPLOYED_MODEL: DeployedModel.id of the `DeployedModel`. (Vertex AI makes this value available to your container code as the [`AIP_DEPLOYED_MODEL_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) - `imageUri` string: Required. Immutable. URI of the Docker image to be used as the custom container for serving predictions. This URI must identify an image in Artifact Registry or Container Registry. Learn more about the [container publishing requirements](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#publishing), including permissions requirements for the Vertex AI Service Agent. The container image is ingested upon ModelService.UploadModel, stored internally, and this original path is afterwards not used. To learn about the requirements for the Docker image itself, see [Custom container requirements](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#). You can use the URI to one of Vertex AI's [pre-built container images for prediction](https://cloud.google.com/vertex-ai/docs/predictions/pre-built-containers) in this field. - `invokeRoutePrefix` string: Immutable. Invoke route prefix for the custom container. "/*" is the only supported value right now. By setting this field, any non-root route on this model will be accessible with invoke http call eg: "/invoke/foo/bar", however the [PredictionService.Invoke] RPC is not supported yet. Only one of `predict_route` or `invoke_route_prefix` can be set, and we default to using `predict_route` if this field is not set. If this field is set, the Model can only be deployed to dedicated endpoint. - `livenessProbe` GoogleCloudAiplatformV1Probe: Probe describes a health check to be performed against a container to determine whether it is alive or ready to receive traffic. - `exec` GoogleCloudAiplatformV1ProbeExecAction: ExecAction specifies a command to execute. - `command` string[]: Command is the command line to execute inside the container, the working directory for the command is root ('/') in the container's filesystem. The command is simply exec'd, it is not run inside a shell, so traditional shell instructions ('|', etc) won't work. To use a shell, you need to explicitly call out to that shell. Exit status of 0 is treated as live/healthy and non-zero is unhealthy. - `failureThreshold` integer: Number of consecutive failures before the probe is considered failed. Defaults to 3. Minimum value is 1. Maps to Kubernetes probe argument 'failureThreshold'. - `grpc` GoogleCloudAiplatformV1ProbeGrpcAction: GrpcAction checks the health of a container using a gRPC service. - `port` integer: Port number of the gRPC service. Number must be in the range 1 to 65535. - `service` string: Service is the name of the service to place in the gRPC HealthCheckRequest. See https://github.com/grpc/grpc/blob/master/doc/health-checking.md. If this is not specified, the default behavior is defined by gRPC. - `httpGet` GoogleCloudAiplatformV1ProbeHttpGetAction: HttpGetAction describes an action based on HTTP Get requests. - `host` string: Host name to connect to, defaults to the model serving container's IP. You probably want to set "Host" in httpHeaders instead. - `httpHeaders` GoogleCloudAiplatformV1ProbeHttpHeader[]: Custom headers to set in the request. HTTP allows repeated headers. - … - `path` string: Path to access on the HTTP server. - `port` integer: Number of the port to access on the container. Number must be in the range 1 to 65535. - `scheme` string: Scheme to use for connecting to the host. Defaults to HTTP. Acceptable values are "HTTP" or "HTTPS". - `initialDelaySeconds` integer: Number of seconds to wait before starting the probe. Defaults to 0. Minimum value is 0. Maps to Kubernetes probe argument 'initialDelaySeconds'. - `periodSeconds` integer: How often (in seconds) to perform the probe. Default to 10 seconds. Minimum value is 1. Must be less than timeout_seconds. Maps to Kubernetes probe argument 'periodSeconds'. - `successThreshold` integer: Number of consecutive successes before the probe is considered successful. Defaults to 1. Minimum value is 1. Maps to Kubernetes probe argument 'successThreshold'. - `tcpSocket` GoogleCloudAiplatformV1ProbeTcpSocketAction: TcpSocketAction probes the health of a container by opening a TCP socket connection. - `host` string: Optional: Host name to connect to, defaults to the model serving container's IP. - `port` integer: Number of the port to access on the container. Number must be in the range 1 to 65535. - `timeoutSeconds` integer: Number of seconds after which the probe times out. Defaults to 1 second. Minimum value is 1. Must be greater or equal to period_seconds. Maps to Kubernetes probe argument 'timeoutSeconds'. - `ports` GoogleCloudAiplatformV1Port[]: Immutable. List of ports to expose from the container. Vertex AI sends any prediction requests that it receives to the first port on this list. Vertex AI also sends [liveness and health checks](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#liveness) to this port. If you do not specify this field, it defaults to following value: ```json [ { "containerPort": 8080 } ] ``` Vertex AI does not use ports other than the first one listed. This field corresponds to the `ports` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `containerPort` integer: The number of the port to expose on the pod's IP address. Must be a valid port number, between 1 and 65535 inclusive. - `predictRoute` string: Immutable. HTTP path on the container to send prediction requests to. Vertex AI forwards requests sent using projects.locations.endpoints.predict to this path on the container's IP address and port. Vertex AI then returns the container's response in the API response. For example, if you set this field to `/foo`, then when Vertex AI receives a prediction request, it forwards the request body in a POST request to the `/foo` path on the port of your container specified by the first value of this `ModelContainerSpec`'s ports field. If you don't specify this field, it defaults to the following value when you deploy this Model to an Endpoint: /v1/endpoints/ENDPOINT/deployedModels/DEPLOYED_MODEL:predict The placeholders in this value are replaced as follows: * ENDPOINT: The last segment (following `endpoints/`)of the Endpoint.name][] field of the Endpoint where this Model has been deployed. (Vertex AI makes this value available to your container code as the [`AIP_ENDPOINT_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) * DEPLOYED_MODEL: DeployedModel.id of the `DeployedModel`. (Vertex AI makes this value available to your container code as the [`AIP_DEPLOYED_MODEL_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) - `sharedMemorySizeMb` string, int64: Immutable. The amount of the VM memory to reserve as the shared memory for the model in megabytes. - `startupProbe` GoogleCloudAiplatformV1Probe: Probe describes a health check to be performed against a container to determine whether it is alive or ready to receive traffic. - `exec` GoogleCloudAiplatformV1ProbeExecAction: ExecAction specifies a command to execute. - `command` string[]: Command is the command line to execute inside the container, the working directory for the command is root ('/') in the container's filesystem. The command is simply exec'd, it is not run inside a shell, so traditional shell instructions ('|', etc) won't work. To use a shell, you need to explicitly call out to that shell. Exit status of 0 is treated as live/healthy and non-zero is unhealthy. - `failureThreshold` integer: Number of consecutive failures before the probe is considered failed. Defaults to 3. Minimum value is 1. Maps to Kubernetes probe argument 'failureThreshold'. - `grpc` GoogleCloudAiplatformV1ProbeGrpcAction: GrpcAction checks the health of a container using a gRPC service. - `port` integer: Port number of the gRPC service. Number must be in the range 1 to 65535. - `service` string: Service is the name of the service to place in the gRPC HealthCheckRequest. See https://github.com/grpc/grpc/blob/master/doc/health-checking.md. If this is not specified, the default behavior is defined by gRPC. - `httpGet` GoogleCloudAiplatformV1ProbeHttpGetAction: HttpGetAction describes an action based on HTTP Get requests. - `host` string: Host name to connect to, defaults to the model serving container's IP. You probably want to set "Host" in httpHeaders instead. - `httpHeaders` GoogleCloudAiplatformV1ProbeHttpHeader[]: Custom headers to set in the request. HTTP allows repeated headers. - … - `path` string: Path to access on the HTTP server. - `port` integer: Number of the port to access on the container. Number must be in the range 1 to 65535. - `scheme` string: Scheme to use for connecting to the host. Defaults to HTTP. Acceptable values are "HTTP" or "HTTPS". - `initialDelaySeconds` integer: Number of seconds to wait before starting the probe. Defaults to 0. Minimum value is 0. Maps to Kubernetes probe argument 'initialDelaySeconds'. - `periodSeconds` integer: How often (in seconds) to perform the probe. Default to 10 seconds. Minimum value is 1. Must be less than timeout_seconds. Maps to Kubernetes probe argument 'periodSeconds'. - `successThreshold` integer: Number of consecutive successes before the probe is considered successful. Defaults to 1. Minimum value is 1. Maps to Kubernetes probe argument 'successThreshold'. - `tcpSocket` GoogleCloudAiplatformV1ProbeTcpSocketAction: TcpSocketAction probes the health of a container by opening a TCP socket connection. - `host` string: Optional: Host name to connect to, defaults to the model serving container's IP. - `port` integer: Number of the port to access on the container. Number must be in the range 1 to 65535. - `timeoutSeconds` integer: Number of seconds after which the probe times out. Defaults to 1 second. Minimum value is 1. Must be greater or equal to period_seconds. Maps to Kubernetes probe argument 'timeoutSeconds'. - `dedicatedResources` GoogleCloudAiplatformV1DedicatedResources: A description of resources that are dedicated to a DeployedModel or DeployedIndex, and that need a higher degree of manual configuration. - `autoscalingMetricSpecs` GoogleCloudAiplatformV1AutoscalingMetricSpec[]: Immutable. The metric specifications that overrides a resource utilization metric (CPU utilization, accelerator's duty cycle, and so on) target value (default to 60 if not set). At most one entry is allowed per metric. If machine_spec.accelerator_count is above 0, the autoscaling will be based on both CPU utilization and accelerator's duty cycle metrics and scale up when either metrics exceeds its target value while scale down if both metrics are under their target value. The default target value is 60 for both metrics. If machine_spec.accelerator_count is 0, the autoscaling will be based on CPU utilization metric only with default target value 60 if not explicitly set. For example, in the case of Online Prediction, if you want to override target CPU utilization to 80, you should set autoscaling_metric_specs.metric_name to `aiplatform.googleapis.com/prediction/online/cpu/utilization` and autoscaling_metric_specs.target to `80`. - `metricName` string: Required. The resource metric name. Supported metrics: * For Online Prediction: * `aiplatform.googleapis.com/prediction/online/accelerator/duty_cycle` * `aiplatform.googleapis.com/prediction/online/cpu/utilization` * `aiplatform.googleapis.com/prediction/online/request_count` * `pubsub.googleapis.com/subscription/num_undelivered_messages` * `prometheus.googleapis.com/vertex_dcgm_fi_dev_gpu_util` * `prometheus.googleapis.com/vertex_vllm_gpu_cache_usage_perc` * `prometheus.googleapis.com/vertex_vllm_num_requests_waiting` - `target` integer: The target resource utilization in percentage (1% - 100%) for the given metric; once the real usage deviates from the target by a certain percentage, the machine replicas change. The default value is 60 (representing 60%) if not provided. - `machineSpec` GoogleCloudAiplatformV1MachineSpec: Specification of a single machine. - `acceleratorCount` integer: The number of accelerators to attach to the machine. For [accelerator optimized machine types](https://cloud.google.com/compute/docs/accelerator-optimized-machines), One may set the accelerator_count from 1 to N for machine with N GPUs. If accelerator_count is less than or equal to N / 2, Agent Platform co-schedules the replicas of the model into the same VM to save cost. For example, if the machine type is a3-highgpu-8g, which has 8 H100 GPUs, one can set accelerator_count to 1 to 8. If accelerator_count is 1, 2, 3, or 4, Agent Platform co-schedules 8, 4, 2, or 2 replicas of the model into the same VM to save cost. When co-scheduling, CPU, memory and storage on the VM will be distributed to replicas on the VM. For example, one can expect a co-scheduled replica requesting 2 GPUs out of a 8-GPU VM will receive 25% of the CPU, memory and storage of the VM. Note that the feature is not compatible with multihost_gpu_node_count. When multihost_gpu_node_count is set, the co-scheduling will not be enabled. - `acceleratorType` 'ACCELERATOR_TYPE_UNSPECIFIED' | 'NVIDIA_TESLA_K80' | 'NVIDIA_TESLA_P100' | 'NVIDIA_TESLA_V100' | 'NVIDIA_TESLA_P4' | 'NVIDIA_TESLA_T4' | 'NVIDIA_TESLA_A100' | 'NVIDIA_A100_80GB' | 'NVIDIA_L4' | 'NVIDIA_H100_80GB' | 'NVIDIA_H100_MEGA_80GB' | 'NVIDIA_H200_141GB' | 'NVIDIA_B200' | 'NVIDIA_GB200' | 'NVIDIA_RTX_PRO_6000' | 'TPU_V2' | 'TPU_V3' | 'TPU_V4_POD' | 'TPU_V5_LITEPOD': Immutable. The type of accelerator(s) that may be attached to the machine as per accelerator_count. - `gpuPartitionSize` string: Optional. Immutable. The Nvidia GPU partition size. When specified, the requested accelerators will be partitioned into smaller GPU partitions. For example, if the request is for 8 units of NVIDIA A100 GPUs, and gpu_partition_size="1g.10gb", the service will create 8 * 7 = 56 partitioned MIG instances. The partition size must be a value supported by the requested accelerator. Refer to [Nvidia GPU Partitioning](https://cloud.google.com/kubernetes-engine/docs/how-to/gpus-multi#multi-instance_gpu_partitions) for the available partition sizes. If set, the accelerator_count should be set to 1. - `machineType` string: Immutable. The type of the machine. See the [list of machine types supported for prediction](https://cloud.google.com/gemini-enterprise-agent-platform/machine-learning/predictions/configure-compute#machine-types) See the [list of machine types supported for custom training](https://cloud.google.com/gemini-enterprise-agent-platform/machine-learning/training/configure-compute#machine-types). For DeployedModel this field is optional, and the default value is `n1-standard-2`. For BatchPredictionJob or as part of WorkerPoolSpec this field is required. - `reservationAffinity` GoogleCloudAiplatformV1ReservationAffinity: A ReservationAffinity can be used to configure a Vertex AI resource (e.g., a DeployedModel) to draw its Compute Engine resources from a Shared Reservation, or exclusively from on-demand capacity. - `key` string: Optional. Corresponds to the label key of a reservation resource. To target a SPECIFIC_RESERVATION by name, use `compute.googleapis.com/reservation-name` as the key and specify the name of your reservation as its value. - `reservationAffinityType` 'TYPE_UNSPECIFIED' | 'NO_RESERVATION' | 'ANY_RESERVATION' | 'SPECIFIC_RESERVATION': Required. Specifies the reservation affinity type. - `values` string[]: Optional. Corresponds to the label values of a reservation resource. This must be the resource name of the reservation, reservation block, or reservation sub- block. - `tpuTopology` string: Immutable. The topology of the TPUs. Corresponds to the TPU topologies available from GKE. (Example: tpu_topology: "2x2x1"). - `maxReplicaCount` integer: Immutable. The maximum number of replicas that may be deployed on when the traffic against it increases. If the requested value is too large, the deployment will error, but if deployment succeeds then the ability to scale to that many replicas is guaranteed (barring service outages). If traffic increases beyond what its replicas at maximum may handle, a portion of the traffic will be dropped. If this value is not provided, will use min_replica_count as the default value. The value of this field impacts the charge against Agent Platform CPU and GPU quotas. Specifically, you will be charged for (max_replica_count * number of cores in the selected machine type) and (max_replica_count * number of GPUs per replica in the selected machine type). - `minReplicaCount` integer: Required. Immutable. The minimum number of machine replicas that will be always deployed on. This value must be greater than or equal to 1. If traffic increases, it may dynamically be deployed onto more replicas, and as traffic decreases, some of these extra replicas may be freed. - `requiredReplicaCount` integer: Optional. Number of required available replicas for the deployment to succeed. This field is only needed when partial deployment/mutation is desired. If set, the deploy/mutate operation will succeed once available_replica_count reaches required_replica_count, and the rest of the replicas will be retried. If not set, the default required_replica_count will be min_replica_count. - `spot` boolean: Optional. If true, schedule the deployment workload on [spot VMs](https://cloud.google.com/kubernetes-engine/docs/concepts/spot-vms). - `deployMetadata` GoogleCloudAiplatformV1PublisherModelCallToActionDeployDeployMetadata: Metadata information about the deployment for managing deployment config. - `labels` object: Optional. Labels for the deployment config. For managing deployment config like verifying, source of deployment config, etc. - `sampleRequest` string: Optional. Sample request for deployed endpoint. - `deployTaskName` string: Optional. The name of the deploy task (e.g., "text to image generation"). - `largeModelReference` GoogleCloudAiplatformV1LargeModelReference: Contains information about the Large Model. - `name` string: Required. The unique name of the large Foundation or pre-built model. Like "chat-bison", "text-bison". Or model name with version ID, like "chat-bison@001", "text-bison@005", etc. - `modelDisplayName` string: Optional. Default model display name. - `publicArtifactUri` string: Optional. The signed URI for ephemeral Cloud Storage access to model artifact. - `sharedResources` string: The resource name of the shared DeploymentResourcePool to deploy on. Format: `projects/{project}/locations/{location}/deploymentResourcePools/{deployment_resource_pool}` - `title` string: Required. The title of the regional resource reference. - `deployGke` GoogleCloudAiplatformV1PublisherModelCallToActionDeployGke: Configurations for PublisherModel GKE deployment - `gkeYamlConfigs` string[]: Optional. GKE deployment configuration in yaml format. - `multiDeployVertex` GoogleCloudAiplatformV1PublisherModelCallToActionDeployVertex: Multiple setups to deploy the PublisherModel. - `multiDeployVertex` GoogleCloudAiplatformV1PublisherModelCallToActionDeploy[]: Optional. One click deployment configurations. - `artifactUri` string: Optional. The path to the directory containing the Model artifact and any of its supporting files. - `automaticResources` GoogleCloudAiplatformV1AutomaticResources: A description of resources that to large degree are decided by Agent Platform, and require only a modest additional configuration. Each Model supporting these resources documents its specific guidelines. - `maxReplicaCount` integer: Immutable. The maximum number of replicas that may be deployed on when the traffic against it increases. If the requested value is too large, the deployment will error, but if deployment succeeds then the ability to scale to that many replicas is guaranteed (barring service outages). If traffic increases beyond what its replicas at maximum may handle, a portion of the traffic will be dropped. If this value is not provided, a no upper bound for scaling under heavy traffic will be assume, though Agent Platform may be unable to scale beyond certain replica number. - `minReplicaCount` integer: Immutable. The minimum number of replicas that will be always deployed on. If traffic against it increases, it may dynamically be deployed onto more replicas up to max_replica_count, and as traffic decreases, some of these extra replicas may be freed. If the requested value is too large, the deployment will error. - `containerSpec` GoogleCloudAiplatformV1ModelContainerSpec: Specification of a container for serving predictions. Some fields in this message correspond to fields in the [Kubernetes Container v1 core specification](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `args` string[]: Immutable. Specifies arguments for the command that runs when the container starts. This overrides the container's [`CMD`](https://docs.docker.com/engine/reference/builder/#cmd). Specify this field as an array of executable and arguments, similar to a Docker `CMD`'s "default parameters" form. If you don't specify this field but do specify the command field, then the command from the `command` field runs without any additional arguments. See the [Kubernetes documentation about how the `command` and `args` fields interact with a container's `ENTRYPOINT` and `CMD`](https://kubernetes.io/docs/tasks/inject-data-application/define-command-argument-container/#notes). If you don't specify this field and don't specify the `command` field, then the container's [`ENTRYPOINT`](https://docs.docker.com/engine/reference/builder/#cmd) and `CMD` determine what runs based on their default behavior. See the Docker documentation about [how `CMD` and `ENTRYPOINT` interact](https://docs.docker.com/engine/reference/builder/#understand-how-cmd-and-entrypoint-interact). In this field, you can reference [environment variables set by Vertex AI](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables) and environment variables set in the env field. You cannot reference environment variables set in the Docker image. In order for environment variables to be expanded, reference them by using the following syntax: $( VARIABLE_NAME) Note that this differs from Bash variable expansion, which does not use parentheses. If a variable cannot be resolved, the reference in the input string is used unchanged. To avoid variable expansion, you can escape this syntax with `$$`; for example: $$(VARIABLE_NAME) This field corresponds to the `args` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `command` string[]: Immutable. Specifies the command that runs when the container starts. This overrides the container's [ENTRYPOINT](https://docs.docker.com/engine/reference/builder/#entrypoint). Specify this field as an array of executable and arguments, similar to a Docker `ENTRYPOINT`'s "exec" form, not its "shell" form. If you do not specify this field, then the container's `ENTRYPOINT` runs, in conjunction with the args field or the container's [`CMD`](https://docs.docker.com/engine/reference/builder/#cmd), if either exists. If this field is not specified and the container does not have an `ENTRYPOINT`, then refer to the Docker documentation about [how `CMD` and `ENTRYPOINT` interact](https://docs.docker.com/engine/reference/builder/#understand-how-cmd-and-entrypoint-interact). If you specify this field, then you can also specify the `args` field to provide additional arguments for this command. However, if you specify this field, then the container's `CMD` is ignored. See the [Kubernetes documentation about how the `command` and `args` fields interact with a container's `ENTRYPOINT` and `CMD`](https://kubernetes.io/docs/tasks/inject-data-application/define-command-argument-container/#notes). In this field, you can reference [environment variables set by Vertex AI](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables) and environment variables set in the env field. You cannot reference environment variables set in the Docker image. In order for environment variables to be expanded, reference them by using the following syntax: $( VARIABLE_NAME) Note that this differs from Bash variable expansion, which does not use parentheses. If a variable cannot be resolved, the reference in the input string is used unchanged. To avoid variable expansion, you can escape this syntax with `$$`; for example: $$(VARIABLE_NAME) This field corresponds to the `command` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `deploymentTimeout` string, google-duration: Immutable. Deployment timeout. Limit for deployment timeout is 2 hours. - `env` GoogleCloudAiplatformV1EnvVar[]: Immutable. List of environment variables to set in the container. After the container starts running, code running in the container can read these environment variables. Additionally, the command and args fields can reference these variables. Later entries in this list can also reference earlier entries. For example, the following example sets the variable `VAR_2` to have the value `foo bar`: ```json [ { "name": "VAR_1", "value": "foo" }, { "name": "VAR_2", "value": "$(VAR_1) bar" } ] ``` If you switch the order of the variables in the example, then the expansion does not occur. This field corresponds to the `env` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). At most 200 environment variables can be specified. Each variable (`NAME=value`) must be smaller than 128 KiB, and the total size of all variables must not exceed 512 KiB. - `name` string: Required. Name of the environment variable. Must be a valid C identifier. - `value` string: Required. Variables that reference a $(VAR_NAME) are expanded using the previous defined environment variables in the container and any service environment variables. If a variable cannot be resolved, the reference in the input string will be unchanged. The $(VAR_NAME) syntax can be escaped with a double $$, ie: $$(VAR_NAME). Escaped references will never be expanded, regardless of whether the variable exists or not. - `grpcPorts` GoogleCloudAiplatformV1Port[]: Immutable. List of ports to expose from the container. Vertex AI sends gRPC prediction requests that it receives to the first port on this list. Vertex AI also sends liveness and health checks to this port. If you do not specify this field, gRPC requests to the container will be disabled. Vertex AI does not use ports other than the first one listed. This field corresponds to the `ports` field of the Kubernetes Containers v1 core API. - `containerPort` integer: The number of the port to expose on the pod's IP address. Must be a valid port number, between 1 and 65535 inclusive. - `healthProbe` GoogleCloudAiplatformV1Probe: Probe describes a health check to be performed against a container to determine whether it is alive or ready to receive traffic. - `exec` GoogleCloudAiplatformV1ProbeExecAction: ExecAction specifies a command to execute. - … - `failureThreshold` integer: Number of consecutive failures before the probe is considered failed. Defaults to 3. Minimum value is 1. Maps to Kubernetes probe argument 'failureThreshold'. - `grpc` GoogleCloudAiplatformV1ProbeGrpcAction: GrpcAction checks the health of a container using a gRPC service. - … - `httpGet` GoogleCloudAiplatformV1ProbeHttpGetAction: HttpGetAction describes an action based on HTTP Get requests. - … - `initialDelaySeconds` integer: Number of seconds to wait before starting the probe. Defaults to 0. Minimum value is 0. Maps to Kubernetes probe argument 'initialDelaySeconds'. - `periodSeconds` integer: How often (in seconds) to perform the probe. Default to 10 seconds. Minimum value is 1. Must be less than timeout_seconds. Maps to Kubernetes probe argument 'periodSeconds'. - `successThreshold` integer: Number of consecutive successes before the probe is considered successful. Defaults to 1. Minimum value is 1. Maps to Kubernetes probe argument 'successThreshold'. - `tcpSocket` GoogleCloudAiplatformV1ProbeTcpSocketAction: TcpSocketAction probes the health of a container by opening a TCP socket connection. - … - `timeoutSeconds` integer: Number of seconds after which the probe times out. Defaults to 1 second. Minimum value is 1. Must be greater or equal to period_seconds. Maps to Kubernetes probe argument 'timeoutSeconds'. - `healthRoute` string: Immutable. HTTP path on the container to send health checks to. Vertex AI intermittently sends GET requests to this path on the container's IP address and port to check that the container is healthy. Read more about [health checks](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#health). For example, if you set this field to `/bar`, then Vertex AI intermittently sends a GET request to the `/bar` path on the port of your container specified by the first value of this `ModelContainerSpec`'s ports field. If you don't specify this field, it defaults to the following value when you deploy this Model to an Endpoint: /v1/endpoints/ENDPOINT/deployedModels/ DEPLOYED_MODEL:predict The placeholders in this value are replaced as follows: * ENDPOINT: The last segment (following `endpoints/`)of the Endpoint.name][] field of the Endpoint where this Model has been deployed. (Vertex AI makes this value available to your container code as the [`AIP_ENDPOINT_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) * DEPLOYED_MODEL: DeployedModel.id of the `DeployedModel`. (Vertex AI makes this value available to your container code as the [`AIP_DEPLOYED_MODEL_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) - `imageUri` string: Required. Immutable. URI of the Docker image to be used as the custom container for serving predictions. This URI must identify an image in Artifact Registry or Container Registry. Learn more about the [container publishing requirements](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#publishing), including permissions requirements for the Vertex AI Service Agent. The container image is ingested upon ModelService.UploadModel, stored internally, and this original path is afterwards not used. To learn about the requirements for the Docker image itself, see [Custom container requirements](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#). You can use the URI to one of Vertex AI's [pre-built container images for prediction](https://cloud.google.com/vertex-ai/docs/predictions/pre-built-containers) in this field. - `invokeRoutePrefix` string: Immutable. Invoke route prefix for the custom container. "/*" is the only supported value right now. By setting this field, any non-root route on this model will be accessible with invoke http call eg: "/invoke/foo/bar", however the [PredictionService.Invoke] RPC is not supported yet. Only one of `predict_route` or `invoke_route_prefix` can be set, and we default to using `predict_route` if this field is not set. If this field is set, the Model can only be deployed to dedicated endpoint. - `livenessProbe` GoogleCloudAiplatformV1Probe: Probe describes a health check to be performed against a container to determine whether it is alive or ready to receive traffic. - `exec` GoogleCloudAiplatformV1ProbeExecAction: ExecAction specifies a command to execute. - … - `failureThreshold` integer: Number of consecutive failures before the probe is considered failed. Defaults to 3. Minimum value is 1. Maps to Kubernetes probe argument 'failureThreshold'. - `grpc` GoogleCloudAiplatformV1ProbeGrpcAction: GrpcAction checks the health of a container using a gRPC service. - … - `httpGet` GoogleCloudAiplatformV1ProbeHttpGetAction: HttpGetAction describes an action based on HTTP Get requests. - … - `initialDelaySeconds` integer: Number of seconds to wait before starting the probe. Defaults to 0. Minimum value is 0. Maps to Kubernetes probe argument 'initialDelaySeconds'. - `periodSeconds` integer: How often (in seconds) to perform the probe. Default to 10 seconds. Minimum value is 1. Must be less than timeout_seconds. Maps to Kubernetes probe argument 'periodSeconds'. - `successThreshold` integer: Number of consecutive successes before the probe is considered successful. Defaults to 1. Minimum value is 1. Maps to Kubernetes probe argument 'successThreshold'. - `tcpSocket` GoogleCloudAiplatformV1ProbeTcpSocketAction: TcpSocketAction probes the health of a container by opening a TCP socket connection. - … - `timeoutSeconds` integer: Number of seconds after which the probe times out. Defaults to 1 second. Minimum value is 1. Must be greater or equal to period_seconds. Maps to Kubernetes probe argument 'timeoutSeconds'. - `ports` GoogleCloudAiplatformV1Port[]: Immutable. List of ports to expose from the container. Vertex AI sends any prediction requests that it receives to the first port on this list. Vertex AI also sends [liveness and health checks](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#liveness) to this port. If you do not specify this field, it defaults to following value: ```json [ { "containerPort": 8080 } ] ``` Vertex AI does not use ports other than the first one listed. This field corresponds to the `ports` field of the Kubernetes Containers [v1 core API](https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.23/#container-v1-core). - `containerPort` integer: The number of the port to expose on the pod's IP address. Must be a valid port number, between 1 and 65535 inclusive. - `predictRoute` string: Immutable. HTTP path on the container to send prediction requests to. Vertex AI forwards requests sent using projects.locations.endpoints.predict to this path on the container's IP address and port. Vertex AI then returns the container's response in the API response. For example, if you set this field to `/foo`, then when Vertex AI receives a prediction request, it forwards the request body in a POST request to the `/foo` path on the port of your container specified by the first value of this `ModelContainerSpec`'s ports field. If you don't specify this field, it defaults to the following value when you deploy this Model to an Endpoint: /v1/endpoints/ENDPOINT/deployedModels/DEPLOYED_MODEL:predict The placeholders in this value are replaced as follows: * ENDPOINT: The last segment (following `endpoints/`)of the Endpoint.name][] field of the Endpoint where this Model has been deployed. (Vertex AI makes this value available to your container code as the [`AIP_ENDPOINT_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) * DEPLOYED_MODEL: DeployedModel.id of the `DeployedModel`. (Vertex AI makes this value available to your container code as the [`AIP_DEPLOYED_MODEL_ID` environment variable](https://cloud.google.com/vertex-ai/docs/predictions/custom-container-requirements#aip-variables).) - `sharedMemorySizeMb` string, int64: Immutable. The amount of the VM memory to reserve as the shared memory for the model in megabytes. - `startupProbe` GoogleCloudAiplatformV1Probe: Probe describes a health check to be performed against a container to determine whether it is alive or ready to receive traffic. - `exec` GoogleCloudAiplatformV1ProbeExecAction: ExecAction specifies a command to execute. - … - `failureThreshold` integer: Number of consecutive failures before the probe is considered failed. Defaults to 3. Minimum value is 1. Maps to Kubernetes probe argument 'failureThreshold'. - `grpc` GoogleCloudAiplatformV1ProbeGrpcAction: GrpcAction checks the health of a container using a gRPC service. - … - `httpGet` GoogleCloudAiplatformV1ProbeHttpGetAction: HttpGetAction describes an action based on HTTP Get requests. - … - `initialDelaySeconds` integer: Number of seconds to wait before starting the probe. Defaults to 0. Minimum value is 0. Maps to Kubernetes probe argument 'initialDelaySeconds'. - `periodSeconds` integer: How often (in seconds) to perform the probe. Default to 10 seconds. Minimum value is 1. Must be less than timeout_seconds. Maps to Kubernetes probe argument 'periodSeconds'. - `successThreshold` integer: Number of consecutive successes before the probe is considered successful. Defaults to 1. Minimum value is 1. Maps to Kubernetes probe argument 'successThreshold'. - `tcpSocket` GoogleCloudAiplatformV1ProbeTcpSocketAction: TcpSocketAction probes the health of a container by opening a TCP socket connection. - … - `timeoutSeconds` integer: Number of seconds after which the probe times out. Defaults to 1 second. Minimum value is 1. Must be greater or equal to period_seconds. Maps to Kubernetes probe argument 'timeoutSeconds'. - `dedicatedResources` GoogleCloudAiplatformV1DedicatedResources: A description of resources that are dedicated to a DeployedModel or DeployedIndex, and that need a higher degree of manual configuration. - `autoscalingMetricSpecs` GoogleCloudAiplatformV1AutoscalingMetricSpec[]: Immutable. The metric specifications that overrides a resource utilization metric (CPU utilization, accelerator's duty cycle, and so on) target value (default to 60 if not set). At most one entry is allowed per metric. If machine_spec.accelerator_count is above 0, the autoscaling will be based on both CPU utilization and accelerator's duty cycle metrics and scale up when either metrics exceeds its target value while scale down if both metrics are under their target value. The default target value is 60 for both metrics. If machine_spec.accelerator_count is 0, the autoscaling will be based on CPU utilization metric only with default target value 60 if not explicitly set. For example, in the case of Online Prediction, if you want to override target CPU utilization to 80, you should set autoscaling_metric_specs.metric_name to `aiplatform.googleapis.com/prediction/online/cpu/utilization` and autoscaling_metric_specs.target to `80`. - `metricName` string: Required. The resource metric name. Supported metrics: * For Online Prediction: * `aiplatform.googleapis.com/prediction/online/accelerator/duty_cycle` * `aiplatform.googleapis.com/prediction/online/cpu/utilization` * `aiplatform.googleapis.com/prediction/online/request_count` * `pubsub.googleapis.com/subscription/num_undelivered_messages` * `prometheus.googleapis.com/vertex_dcgm_fi_dev_gpu_util` * `prometheus.googleapis.com/vertex_vllm_gpu_cache_usage_perc` * `prometheus.googleapis.com/vertex_vllm_num_requests_waiting` - `target` integer: The target resource utilization in percentage (1% - 100%) for the given metric; once the real usage deviates from the target by a certain percentage, the machine replicas change. The default value is 60 (representing 60%) if not provided. - `machineSpec` GoogleCloudAiplatformV1MachineSpec: Specification of a single machine. - `acceleratorCount` integer: The number of accelerators to attach to the machine. For [accelerator optimized machine types](https://cloud.google.com/compute/docs/accelerator-optimized-machines), One may set the accelerator_count from 1 to N for machine with N GPUs. If accelerator_count is less than or equal to N / 2, Agent Platform co-schedules the replicas of the model into the same VM to save cost. For example, if the machine type is a3-highgpu-8g, which has 8 H100 GPUs, one can set accelerator_count to 1 to 8. If accelerator_count is 1, 2, 3, or 4, Agent Platform co-schedules 8, 4, 2, or 2 replicas of the model into the same VM to save cost. When co-scheduling, CPU, memory and storage on the VM will be distributed to replicas on the VM. For example, one can expect a co-scheduled replica requesting 2 GPUs out of a 8-GPU VM will receive 25% of the CPU, memory and storage of the VM. Note that the feature is not compatible with multihost_gpu_node_count. When multihost_gpu_node_count is set, the co-scheduling will not be enabled. - `acceleratorType` 'ACCELERATOR_TYPE_UNSPECIFIED' | 'NVIDIA_TESLA_K80' | 'NVIDIA_TESLA_P100' | 'NVIDIA_TESLA_V100' | 'NVIDIA_TESLA_P4' | 'NVIDIA_TESLA_T4' | 'NVIDIA_TESLA_A100' | 'NVIDIA_A100_80GB' | 'NVIDIA_L4' | 'NVIDIA_H100_80GB' | 'NVIDIA_H100_MEGA_80GB' | 'NVIDIA_H200_141GB' | 'NVIDIA_B200' | 'NVIDIA_GB200' | 'NVIDIA_RTX_PRO_6000' | 'TPU_V2' | 'TPU_V3' | 'TPU_V4_POD' | 'TPU_V5_LITEPOD': Immutable. The type of accelerator(s) that may be attached to the machine as per accelerator_count. - `gpuPartitionSize` string: Optional. Immutable. The Nvidia GPU partition size. When specified, the requested accelerators will be partitioned into smaller GPU partitions. For example, if the request is for 8 units of NVIDIA A100 GPUs, and gpu_partition_size="1g.10gb", the service will create 8 * 7 = 56 partitioned MIG instances. The partition size must be a value supported by the requested accelerator. Refer to [Nvidia GPU Partitioning](https://cloud.google.com/kubernetes-engine/docs/how-to/gpus-multi#multi-instance_gpu_partitions) for the available partition sizes. If set, the accelerator_count should be set to 1. - `machineType` string: Immutable. The type of the machine. See the [list of machine types supported for prediction](https://cloud.google.com/gemini-enterprise-agent-platform/machine-learning/predictions/configure-compute#machine-types) See the [list of machine types supported for custom training](https://cloud.google.com/gemini-enterprise-agent-platform/machine-learning/training/configure-compute#machine-types). For DeployedModel this field is optional, and the default value is `n1-standard-2`. For BatchPredictionJob or as part of WorkerPoolSpec this field is required. - `reservationAffinity` GoogleCloudAiplatformV1ReservationAffinity: A ReservationAffinity can be used to configure a Vertex AI resource (e.g., a DeployedModel) to draw its Compute Engine resources from a Shared Reservation, or exclusively from on-demand capacity. - … - `tpuTopology` string: Immutable. The topology of the TPUs. Corresponds to the TPU topologies available from GKE. (Example: tpu_topology: "2x2x1"). - `maxReplicaCount` integer: Immutable. The maximum number of replicas that may be deployed on when the traffic against it increases. If the requested value is too large, the deployment will error, but if deployment succeeds then the ability to scale to that many replicas is guaranteed (barring service outages). If traffic increases beyond what its replicas at maximum may handle, a portion of the traffic will be dropped. If this value is not provided, will use min_replica_count as the default value. The value of this field impacts the charge against Agent Platform CPU and GPU quotas. Specifically, you will be charged for (max_replica_count * number of cores in the selected machine type) and (max_replica_count * number of GPUs per replica in the selected machine type). - `minReplicaCount` integer: Required. Immutable. The minimum number of machine replicas that will be always deployed on. This value must be greater than or equal to 1. If traffic increases, it may dynamically be deployed onto more replicas, and as traffic decreases, some of these extra replicas may be freed. - `requiredReplicaCount` integer: Optional. Number of required available replicas for the deployment to succeed. This field is only needed when partial deployment/mutation is desired. If set, the deploy/mutate operation will succeed once available_replica_count reaches required_replica_count, and the rest of the replicas will be retried. If not set, the default required_replica_count will be min_replica_count. - `spot` boolean: Optional. If true, schedule the deployment workload on [spot VMs](https://cloud.google.com/kubernetes-engine/docs/concepts/spot-vms). - `deployMetadata` GoogleCloudAiplatformV1PublisherModelCallToActionDeployDeployMetadata: Metadata information about the deployment for managing deployment config. - `labels` object: Optional. Labels for the deployment config. For managing deployment config like verifying, source of deployment config, etc. - `sampleRequest` string: Optional. Sample request for deployed endpoint. - `deployTaskName` string: Optional. The name of the deploy task (e.g., "text to image generation"). - `largeModelReference` GoogleCloudAiplatformV1LargeModelReference: Contains information about the Large Model. - `name` string: Required. The unique name of the large Foundation or pre-built model. Like "chat-bison", "text-bison". Or model name with version ID, like "chat-bison@001", "text-bison@005", etc. - `modelDisplayName` string: Optional. Default model display name. - `publicArtifactUri` string: Optional. The signed URI for ephemeral Cloud Storage access to model artifact. - `sharedResources` string: The resource name of the shared DeploymentResourcePool to deploy on. Format: `projects/{project}/locations/{location}/deploymentResourcePools/{deployment_resource_pool}` - `title` string: Required. The title of the regional resource reference. - `openEvaluationPipeline` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `openFineTuningPipeline` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `openFineTuningPipelines` GoogleCloudAiplatformV1PublisherModelCallToActionOpenFineTuningPipelines: Open fine tuning pipelines. - `fineTuningPipelines` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences[]: Required. Regional resource references to fine tuning pipelines. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `openGenerationAiStudio` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `openGenie` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `openNotebook` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `openNotebooks` GoogleCloudAiplatformV1PublisherModelCallToActionOpenNotebooks: Open notebooks. - `notebooks` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences[]: Required. Regional resource references to notebooks. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `openPromptTuningPipeline` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `requestAccess` GoogleCloudAiplatformV1PublisherModelCallToActionRegionalResourceReferences: The regional resource name or the URI. Key is region, e.g., us-central1, europe-west2, global, etc.. - `colabNotebookDisabled` boolean: Optional. For notebook resource. When set to true, the Colab Enterprise link will be disabled in the "open notebook" dialog in UI. - `references` object: Required. - `resourceDescription` string: Optional. Description of the resource. - `resourceTitle` string: Optional. Title of the resource. - `resourceUseCase` string: Optional. Use case (CUJ) of the resource. - `supportsWorkbench` boolean: Optional. For notebook resource, whether the notebook supports Workbench. - `title` string: Required. - `viewRestApi` GoogleCloudAiplatformV1PublisherModelCallToActionViewRestApi: Rest API docs. - `documentations` GoogleCloudAiplatformV1PublisherModelDocumentation[]: Required. - `content` string: Required. Content of this piece of document (in Markdown format). - `title` string: Required. E.g., OVERVIEW, USE CASES, DOCUMENTATION, SDK & SAMPLES, JAVA, NODE.JS, etc.. - `title` string: Required. The title of the view rest API. - `versionId` string: Output only. Immutable. The version ID of the PublisherModel. A new version is committed when a new model version is uploaded under an existing model id. It is an auto-incrementing decimal number in string representation. - `versionState` 'VERSION_STATE_UNSPECIFIED' | 'VERSION_STATE_STABLE' | 'VERSION_STATE_UNSTABLE': Optional. Indicates the state of the model version. ## Changes - **2026-11-06** `3aca3b348f0c`: 4 info - the security scope `https://www.googleapis.com/auth/aiplatform` was added to the endpoint's security scheme `Oauth2` - the security scope `https://www.googleapis.com/auth/aiplatform` was added to the endpoint's security scheme `Oauth2c` - the security scope `https://www.googleapis.com/auth/cloud-platform` was removed from the endpoint's security scheme `Oauth2` - the security scope `https://www.googleapis.com/auth/cloud-platform` was removed from the endpoint's security scheme `Oauth2c` - **2026-10-30** `34fcc627b062`: 4 info - the security scope `https://www.googleapis.com/auth/aiplatform` was added to the endpoint's security scheme `Oauth2` - the security scope `https://www.googleapis.com/auth/aiplatform` was added to the endpoint's security scheme `Oauth2c` - the security scope `https://www.googleapis.com/auth/cloud-platform` was removed from the endpoint's security scheme `Oauth2` - the security scope `https://www.googleapis.com/auth/cloud-platform` was removed from the endpoint's security scheme `Oauth2c` [Operation history](https://skmtc.dev/google/apis/aiplatform/changes/v1/publishers/:publishersId/models/:modelsId/get.md) --- [API](https://skmtc.dev/google/apis/aiplatform.md) - [All operations](https://skmtc.dev/google/apis/aiplatform/llms.txt) - [OpenAPI document](https://skmtc.dev/google/apis/aiplatform/revisions/3aca3b348f0c?raw)