tiny-recursive-rs 0.1.0

Rust implementation of Tiny Recursive Models for efficient puzzle solving
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

/// Neural network layer primitives
///
/// This module contains the building blocks for the TRM model:
/// - Attention mechanisms (multi-head, grouped-query)
/// - Positional encodings (RoPE, learned)
/// - Activations (SwiGLU, LinearSwish)
/// - Normalizations (RMS LayerNorm)
/// - Embeddings (with automatic dtype casting)

pub mod attention;
pub mod embeddings;
pub mod normalization;
pub mod activations;
pub mod positional;

pub use attention::Attention;
pub use embeddings::CastedEmbedding;
pub use normalization::RMSNorm;
pub use activations::{SwiGLU, LinearSwish};
pub use positional::RotaryEmbedding;