mamba-rs 0.7.3

Mamba SSM and Mamba-3 SISO in Rust with optional CUDA acceleration: inference and training (BPTT through the SSM state, AdamW) on CPU and GPU, custom NVRTC-compiled kernels, CUDA Graph capture, f32 / bf16 / f16 storage, deterministic batch-invariant GEMMs by default with explicit cuBLAS Fast and Pedantic modes.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13

//! HuggingFace checkpoint loading for Mamba LLM inference.
//!
//! Supports both HF-native (`-hf`) and original (`mamba_ssm`) config formats.
//! Handles safetensors (single + multi-shard), bf16 upcast, key remapping.

pub mod bf16;
pub mod config_json;
pub mod embed;
pub mod keys;
pub mod load;

pub use config_json::ModelFamily;
pub use load::load_hf;