Expand description
NAPI-RS bindings for attention mechanisms
Provides Node.js bindings for all attention variants:
- Scaled dot-product attention
- Multi-head attention
- Hyperbolic attention
- Flash attention
- Linear attention
- Local-global attention
- Mixture of Experts attention
Structs§
- Attention
Config - Attention configuration object
- DotProduct
Attention - Scaled dot-product attention
- Flash
Attention - Flash attention with tiled computation
- Hyperbolic
Attention - Hyperbolic attention in Poincaré ball model
- Linear
Attention - Linear attention (Performer-style) with O(n) complexity
- Local
Global Attention - Local-global attention (Longformer-style)
- MoEAttention
- Mixture of Experts attention
- MoEConfig
- MoE attention configuration
- Multi
Head Attention - Multi-head attention mechanism
Functions§
- exp_map
- Exponential map from tangent space to hyperbolic space
- log_map
- Logarithmic map from hyperbolic space to tangent space
- mobius_
addition - Möbius addition in hyperbolic space
- poincare_
distance - Compute hyperbolic (Poincaré) distance between two points
- project_
to_ poincare_ ball - Project a vector into the Poincaré ball