Crate npu_rs

Crate npu_rs 

Source
Expand description

NPU Driver for 20 TOPS RISC Board

A complete driver implementation for neural processing units with support for:

  • Matrix multiplication and convolution operations
  • Dynamic voltage and frequency scaling (DVFS)
  • Thermal management
  • Performance monitoring
  • Model quantization (PTQ)
  • Graph optimization
  • Profiling

Re-exports§

pub use error::NpuError;
pub use error::Result;
pub use device::NpuDevice;
pub use device::DeviceInfo;
pub use device::DeviceState;
pub use device::DeviceRegistry;
pub use execution::ExecutionContext;
pub use execution::BatchScheduler;
pub use memory::MemoryManager;
pub use memory::MemoryPool;
pub use memory::MemoryStats;
pub use model::ModelRuntime;
pub use model::ModelConfig;
pub use model::QuantFormat;
pub use model::OptimizationLevel;
pub use model::NeuralNetwork;
pub use model::Layer;
pub use model::LayerType;
pub use compute::MatMulUnit;
pub use compute::ConvUnit;
pub use power::DvfsController;
pub use power::PowerDomain;
pub use power::ThermalManager;
pub use power::PowerState;
pub use quantization::QuantStats;
pub use quantization::QuantConverter;
pub use quantization::PTQEngine;
pub use optimizer::GraphOptimizer;
pub use optimizer::ComputationGraph;
pub use optimizer::ComputeNode;
pub use optimizer::FusionPattern;
pub use profiler::Profiler;
pub use profiler::ProfileEvent;
pub use profiler::ProfileReport;
pub use tensor::Tensor;
pub use perf_monitor::PerformanceMonitor;
pub use perf_monitor::PerformanceMetrics;

Modules§

compute
device
error
execution
memory
model
optimizer
perf_monitor
power
profiler
quantization
tensor