FuriosaAI NPU & SDK 0.6.0 Documents

This document explains FuriosaAI NPU and its SDKs.

Note

FuriosaAI software components include kernel driver, firmware, runtime, C SDK, Python SDK, and command lines tools. Currently, we offer them for only users who register Early Access Program (EAP) and agree to End User Licence Agreement (EULA). Please contact contact@furiosa.ai to learn how to start the EAP.

FuriosaAI NPU

• FuriosaAI NPU

• Introduction to FuriosaAI Warboy: Warboy HW specification and its performance

• List of Supported Operators for NPU Acceleration

FuriosaAI Software

• FuriosaAI SW Stack Introduction

• Driver, Firmware, and Runtime Installation

• Python SDK Installation & User Guide

• Installation and User Guide of C SDK

• Command Line Tools

• Compiler

• Model Quantization

• Kubernetes Support

FuriosaAI SDK Tutorial and Examples

• Tutorial: How to use Furiosa SDK from Start to Finish

• Tutorial: Basic Inference API

• Tutorial: Advanced Inference API

• Example: Comparing Accuracy with CPU-based Inference

• Example: Image Classification Inference

• Example: SSD Object Detection Inference

• Other Python SDK Examples

Serving, Model Deployment, MLOps

• Model Server (Serving Framework)

• Kubernetes Support

References

• C SDK Reference

• Python API Reference

Other Links

• FuriosaAI Home

• FuriosaAI Customer Support Center

• Bug Report