Docs

GPU Compute Service

Installing NVIDIA Tesla drivers

Installing NVIDIA-Fabric Manager packages

Scenarios

The NVIDIA-Fabric Manager service enables interconnection between multiple graphics cards via NVSwitch. For more information about NVSwitch, visit NVIDIA official website.

warning

For instances that support NVSwitch, refer to the feature overview of each instance type. If the NVIDIA-Fabric Manager service corresponding to the GPU driver version is not installed, you may fail to use this type of GPU instance normally.

In the pni3l instance type family, instances equipped with two or more GPU cards are configured with an NVLink device by default. If the nvidia-fabricmanager.service status is failed, this is normal and does not affect business operations.

When you upgrade the GPU driver for an NVSwitch-supported instance, upgrading the Fabric Manager is also required. Otherwise, you fail to use the instance. How do I upgrade NVIDIA Tesla driver?

Public images provided by the cloud platform have the NVIDIA-Fabric Manager package and the devel package installed by default. You only need to start NVIDIA-Fabric Manager to enable NVSwitch interconnection.

Since custom images have no NVIDIA-Fabric Manager installed, after you use a custom image to create a GPU instance integrated with the NVSwitch, you are required to install the NVIDIA-Fabric Manager package that matches the GPU driver version.

Step 1: Install NVIDIA-Fabric Manager

You can install the NVIDIA-Fabric Manager service via the installation package or source code. In the following example, the GPU driver of version 470.57.02 is used to describe how to install and start the NVIDIA-Fabric Manager service. To download a GPU driver of a different version, replace the version number in the commands with the corresponding version number of the GPU driver. You can execute the nvidia-smi command to view the GPU driver version.

Method 1: Install via installation package

CentOS 8.x

wget https://developer.download.nvidia.cn/compute/cuda/repos/rhel8/x86_64/nvidia-fabric-manager-470.57.02-1.x86_64.rpm
rpm -ivh nvidia-fabric-manager-470.57.02-1.x86_64.rpm

CentOS 7.x

wget https://developer.download.nvidia.cn/compute/cuda/repos/rhel7/x86_64/nvidia-fabric-manager-470.57.02-1.x86_64.rpm
rpm -ivh nvidia-fabric-manager-470.57.02-1.x86_64.rpm

Ubuntu 20.04

wget https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu2004/x86_64/nvidia-fabricmanager-470_470.57.02-1_amd64.deb
dpkg -i nvidia-fabricmanager-470_470.57.02-1_amd64.deb

Ubuntu 18.04

wget https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu1804/x86_64/nvidia-fabricmanager-470_470.57.02-1_amd64.deb
dpkg -i nvidia-fabricmanager-470_470.57.02-1_amd64.deb

Debain 10, veLinux 1.0

wget https://developer.download.nvidia.cn/compute/cuda/repos/debian10/x86_64/nvidia-fabricmanager-470_470.57.02-1_amd64.deb
dpkg -i nvidia-fabricmanager-470_470.57.02-1_amd64.deb

Method 2: Install via source code

CentOS 8.x

dnf config-manager --add-repo http://developer.download.nvidia.com/compute/cuda/repos/rhel8/x86_64/cuda-rhel8.repo
dnf module enable -y nvidia-driver:470
dnf install -y nvidia-fabric-manager-0:470.57.02-1

CentOS 7.x

yum -y install yum-utils
yum-config-manager --add-repo https://developer.download.nvidia.cn/compute/cuda/repos/rhel7/x86_64/cuda-rhel7.repo
yum install -y nvidia-fabric-manager-470.57.02-1

Ubuntu 20.04

wget https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu2004/x86_64/cuda-ubuntu2004.pin
mv cuda-ubuntu2004.pin /etc/apt/preferences.d/cuda-repository-pin-600
wget https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu2004/x86_64/7fa2af80.pub
apt-key add 7fa2af80.pub
rm 7fa2af80.pub
echo "deb http://developer.download.nvidia.cn/compute/cuda/repos/ubuntu2004/x86_64 /" | tee /etc/apt/sources.list.d/cuda.list
apt-get update
apt-get -y install nvidia-fabricmanager-470=470.57.02-1

Ubuntu 18.04

wget https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu1804/x86_64/cuda-ubuntu1804.pin
mv cuda-ubuntu1804.pin /etc/apt/preferences.d/cuda-repository-pin-600
wget https://developer.download.nvidia.cn/compute/cuda/repos/ubuntu1804/x86_64/7fa2af80.pub
apt-key add 7fa2af80.pub
rm 7fa2af80.pub
echo "deb http://developer.download.nvidia.cn/compute/cuda/repos/ubuntu1804/x86_64 /" | tee /etc/apt/sources.list.d/cuda.list
apt-get update
apt-get -y install nvidia-fabricmanager-470=470.57.02-1

Step 2: Install Nvidia-Fabric-Manager-devel

CentOS 7.x/8.x

yum install nvidia-fabric-manager-devel-470.57.02-1 -y

Ubuntu 20.04/18.04, Debain 10, veLinux 1.0

dpkg -i nvidia-fabric-manager-devel-470.57.02-1_amd64.deb

Step 3: Start NVIDIA-Fabric Manager

Execute the following command to start the Fabric Manager service.

sudo systemctl start nvidia-fabricmanager

Execute the following command to check whether the Fabric Manager service starts as expected. If the output is active (running), the service starts as expected.

sudo systemctl status nvidia-fabricmanager

Execute the following command to specify that the Fabric Manager service starts automatically when the instance starts.

sudo systemctl enable nvidia-fabricmanager

Last updated: 2026.04.08 12:09:36