ruvector-nervous-system 2.0.6

Bio-inspired neural system with spiking networks, BTSP learning, and EWC plasticity
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22

//! Modern Hopfield Networks
//!
//! This module implements the modern Hopfield network formulation from
//! Ramsauer et al. (2020), which provides exponential storage capacity
//! and is mathematically equivalent to transformer attention.
//!
//! ## Components
//!
//! - [`ModernHopfield`]: Main network structure
//! - [`retrieval`]: Softmax-weighted retrieval implementation
//! - [`capacity`]: Capacity calculations and β tuning

mod capacity;
mod network;
mod retrieval;

pub use capacity::{optimal_beta, theoretical_capacity};
pub use network::ModernHopfield;
pub use retrieval::{compute_attention, softmax};

#[cfg(test)]
mod tests;