ruvector-attention 2.1.0

Attention mechanisms for ruvector - geometric, graph, and sparse attention
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32

//! Topology Gated Attention
//!
//! Uses topological structure as a permission signal for attention.
//!
//! ## Key Concepts
//!
//! 1. **Window-Level Coherence**: Compute one coherence score per window, reuse for all queries
//! 2. **Fast Graph Primitives**: Use k-NN lists instead of full graph construction
//! 3. **3-Mode Policy**: stable/cautious/freeze based on coherence
//! 4. **Amortized Updates**: Update coherence every T tokens, not every token
//!
//! ## Modes
//!
//! - **Stable**: Full attention, normal updates
//! - **Cautious**: Reduced attention width, increased sparsity
//! - **Freeze**: Retrieval only, no updates, no writes

mod coherence;
mod gated_attention;
mod policy;

pub use coherence::{CoherenceMetric, WindowCoherence};
pub use gated_attention::{TopologyGatedAttention, TopologyGatedConfig};
pub use policy::{AttentionMode, AttentionPolicy, PolicyConfig};

#[cfg(test)]
mod tests {
    #[test]
    fn test_module_exists() {
        assert!(true);
    }
}