FuriosaAI NPU & SDK 0.10.1 Documents

This document explains FuriosaAI NPU and its SDKs.

Note

FuriosaAI software components include kernel driver, firmware, runtime, C SDK, Python SDK, and command lines tools. Currently, we offer them for only users who register Early Access Program (EAP) and agree to End User Licence Agreement (EULA). Please contact contact@furiosa.ai to learn how to start the EAP.

FuriosaAI NPU

• Introduction to FuriosaAI Warboy: HW specification, performance, and supported operators

FuriosaAI Software

• FuriosaAI SW Stack Introduction

• Driver, Firmware, and Runtime Installation

• Python SDK installation and user guide

• C SDK installation and user guide

• Command Line Tools

• Compiler

• Model Quantization

• FuriosaAI Model Zoo

• Kubernetes Support

• Configuring Warboy Pass-through for Virtual Machine

FuriosaAI SDK Tutorial and Examples

• Tutorial: How to use Furiosa SDK from Start to Finish

• Tutorial: Basic Inference API

• Tutorial: Advanced Inference API

• Example: Comparing Accuracy with CPU-based Inference

• Example: Image Classification Inference

• Example: SSD Object Detection Inference

• Other Python SDK Examples

Serving, Model Deployment, MLOps

• Model Server (Serving Framework)

• Kubernetes Support

References

• C Language SDK Reference

• Python SDK Reference

Other Links

• FuriosaAI Home

• FuriosaAI Customer Support Center

• Bug Report