ruvector-attention 2.1.0

Attention mechanisms for ruvector - geometric, graph, and sparse attention
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13

//! Sparse attention mechanisms for efficient computation on long sequences
//!
//! This module provides sparse attention patterns that reduce complexity from O(n²) to sub-quadratic.

pub mod flash;
pub mod linear;
pub mod local_global;
pub mod mask;

pub use flash::FlashAttention;
pub use linear::LinearAttention;
pub use local_global::LocalGlobalAttention;
pub use mask::{AttentionMask, SparseMaskBuilder};