FuriosaAI SDK Documentation

This document covers the process for installing and using the FuriosaAI SDK.

Note

The FuriosaAI SDK includes command line tools, runtime libraries, and Python libraries. FuriosaAI NPU’s kernel driver, firmware, and runtime are distributed according to FuriosaAI’s evaluation program registration and End User License Agreement. For questions about downloading and evaluating the program, please contact us at contact@furiosa.ai.

SDK Installation

• SDK Installation Prerequisites (Required)

• NPU Kernel Driver and Firmware Installation (Required)

• NPU Runtime Installation (Required) : NPU Runtime and Application Tools

• NPU Python SDK Installation (Optional) : Python Library and Command Line Tool for NPU Usage

• Web Service API key setting (Optional) : API Key Setting for Using Tools Provided as Web Services

Quickstart

• Command Line Tools Quickstart

• Python SDK Quickstart

Advanced Topics

• Model Quantization

• NPU Acceleration Operators List

Code Examples

• Python SDK Quantization

• Python SDK Inference

Other links

• FuriosaAI Homepage

• FuriosaAI SDK Github

• C Language SDK Reference

• Python SDK Reference