Struct TinyRecursiveModel 

pub struct TinyRecursiveModel { /* private fields */ }

Main Tiny Recursive Model

Implements the recursive reasoning architecture with H-cycles and L-cycles.

Implementations

impl TinyRecursiveModel

pub fn new(config: TRMConfig, vb: VarBuilder<'_>) -> Result<Self>

Create new TinyRecursiveModel

pub fn empty_carry(&self, batch_size: usize) -> Result<InnerCarry>

Create empty carry for a batch

pub fn reset_carry( &self, reset_flag: &Tensor, carry: &InnerCarry, ) -> Result<InnerCarry>

Reset carry to initial states where reset_flag is true

Arguments

• reset_flag - Boolean tensor [batch_size] indicating which sequences to reset
• carry - Current carry state

pub fn forward( &self, carry: &InnerCarry, input: &Tensor, ) -> Result<(InnerCarry, Tensor)>

Forward pass with recursive reasoning

Arguments

• carry - Current state (z_H, z_L)
• input - Input token IDs [batch, seq_len]

Returns

Tuple of (new_carry, logits)

• new_carry: Updated state for next iteration
• logits: Output logits [batch, seq_len, vocab_size]