Driver, Firmware, and Runtime Installation

Here, we explain how to install the packages necessary to use the various SW components provided by FuriosaAI.

These required packages are kernel drivers, firmware, and runtime library, and can be downloaded either directly through the download center, or through the APT/PIP servers as issued on the developer site.

Note

The download center and developer site will be provided upon registration to the FuriosaAI evaluation program. Currently, the request for registration can be done through contact@furiosa.ai.

Minimum requirements for SDK installation

Ubuntu 18.04 LTS (Bionic Beaver)/Debian buster or higher
Administrator privileges on system (root)
Internet-accessible network

APT server configuration

In order to use the APT server as provided by FuriosaAI, the APT server must be configured on Ubuntu or Debian Linux as delineated below. This section may be skipped if you are using the download center, and not the APT.

Install the necessary packages to access HTTPS-based APT server.

sudo apt update
sudo apt install -y ca-certificates apt-transport-https gnupg

Register the FuriosaAI public Signing key.

sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-key 5F03AFA423A751913F249259814F888B20B09A7E

Issue the API key from FuriosaAI developer center, and configure the API key as follows:

sudo tee -a /etc/apt/auth.conf.d/furiosa.conf > /dev/null <<EOT
  machine archive.furiosa.ai
  login xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  password xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
EOT

sudo chmod 400 /etc/apt/auth.conf.d/furiosa.conf

Configure the APT server according to the explanation given in the Linux distribution version tab.

Register the APT server through the command below.

sudo tee -a /etc/apt/sources.list.d/furiosa.list <<EOT
deb [arch=amd64] https://archive.furiosa.ai/ubuntu bionic restricted
EOT

Register the APT server through the command below.

sudo tee -a /etc/apt/sources.list.d/furiosa.list <<EOT
deb [arch=amd64] https://archive.furiosa.ai/ubuntu focal restricted
EOT

Installing required packages.

If you have registered the APT server as above, or registered on the download site, you will be able to install the required packages - NPU kernel driver, firmware, and runtime.

sudo apt-get update && sudo apt-get install -y furiosa-driver-pdma furiosa-libnux

Select the latest version of the packages below, download them, and install them in order as written in the command. Update the x.y.z-? version portions in accordance with the downloaded files.

NPU Driver (furiosa-driver-pdma)
Firmware (furiosa-libhal)
Runtime library (furiosa-libnux)
Onnxruntime (libonnxruntime)

sudo apt-get install -y ./furiosa-driver-pdma-x.y.z-?.deb
sudo apt-get install -y ./furiosa-libhal-warboy-x.y.z-?.deb
sudo apt-get install -y ./libonnxruntime-x.y.z-?.deb
sudo apt-get install -y ./furiosa-libnux-x.y.z-?.deb

Holding/unholding installed version

Following package installation, in order to maintain a stable operating environment, there may be a need to hold the installed packages versions. By using the command below, you will be able to hold the currently installed versions.

sudo apt-mark hold furiosa-driver-pdma furiosa-libhal-warboy furiosa-libnux libonnxruntime

In order to unhold and update the current package versions, designate the package that you wish to unhold with the command apt-mark unhold. Here, you can state the name of the package, thereby unholding selectively a specific package. In order to show the properties of an already held package, use the command apt-mark showhold.

sudo apt-mark unhold furiosa-driver-pdma furiosa-libhal-warboy furiosa-libnux libonnxruntime

Installing a specific version

If you need to install a specific version, you may designate the version that you want and install as follows.

Check available versions through apt list.

sudo apt list -a furiosa-libnux

State the package name and version as options in the command apt-get install

sudo apt-get install -y furiosa-libnux=0.6.0-2