Docs

Volcengine Kubernetes Engine

GPU-accelerated computing instance

Create a GPU-accelerated instance by specifying a VCI specification.

You can create VCIs by specifying VCI specifications. This topic mainly describes how to specify VCI specifications to create GPU-accelerated instances.

Usage limits

The supported regions and availability zones vary based on different GPU-accelerated instance families. For details, see Regions and availability zones.

When you create a GPU Accelerated instance, different configurations match different VCI instance specifications. For the detailed specification matching logic, see Instance specification normalization.

Prerequisites

A cluster for VCI applications has been created. For details, see Using VCI in VPC-CNI clusters and Using VCI in Flannel clusters.

A VPC and its subnet have been created. For details, see Creating VPCs.

Creating instances by using Kubernetes

When you create a pod or a workload, including a Deployment, StatefulSet, Job, and CronJob, specify VCI specifications by adding an annotation.

The following table describes the annotation.

Annotation key	Annotation sample value	Description	Required
vci.vke.volcengine.com/preferred-instance-types	vci.g1v.8xlarge	The instance specification of the GPU-accelerated type. The instance specifications include the GPU model, number of GPUs, number of CPUs, and amount of memory. You can specify the vCPU, memory, and GPU quantity for each container by defining the request and limit for the container. For detailed specifications, see GPU-accelerated. tip Billing is performed based on the specified instance specification. For billing descriptions, see Product billing. For the value description of the annotation used to create a general-purpose instance, see Creating general-purpose instances by specifying VCI specifications. You can specify multiple instance families (annotation values). Separate multiple instance families with commas (,), and determine the priority by the order in which they are entered. If the higher-priority instance family has no available resources, the lower-priority instance family will be used to create instances.	Required for this scenario
vci.vke.volcengine.com/gpu-driver-version	tesla-470.129.06	Specify the driver version of the GPU-accelerated instance. The annotation value is in the following format: tesla-{NVIDIA driver version}. The available {NVIDIA driver version} varies depending on the GPU accelerated specifications specified in preferred-instance-family. For details, see Supported GPU driver versions. tip If you do not specify this annotation, the system automatically specifies the default NVIDIA driver version that corresponds to the GPU-accelerated instance family that you selected.	Optional

The following sample code shows how to create a Deployment.

tip

The GPU settings under Pod.spec.container[].resources must align with native Kubernetes capabilities and limitations.

Use <vendor>.com/gpu to specify GPU resources.

The limits option is required.

Both limits and requests can be configured, but their values must be identical.

If the requests option is left empty, Kubernetes will use the limits value as the requests value by default.

GPU cannot be shared and overcommitted.

The number of GPUs must be an integer.

Using the console

Install the nvidia-device-plugin add-on in the VCI cluster. For details, see Installing add-ons.

Specify the following parameters when you create a workload.

Basic information: Select Volcengine Container Instance for the Computing power type parameter.

Container configuration: Configure GPU resources in the ResourceQuota section.

Specify the parameter in the red box in the following figure. Set the GPU resource type parameter to Nvidia. Specify other parameters based on your business requirements.

tip

The mGPU resource type is not supported in VCI scenarios.

Advanced settings: Configure the instance specifications in the VCI specification settings section. You can use the default instance family or specify a custom instance family.

When you specify instance families, you can select multiple instance families of the same instance type. The priority is determined by the order in which they are selected (For parameter descriptions, see Specific specifications). If the higher-priority specification family has no available resources, the lower-priority specification family will be used to create instances.

Last updated: 2026.09.03 15:56:09