Struct RecurrentState 

pub struct RecurrentState {
    pub conv: Vec<f32>,
    pub ssm: Vec<f32>,
}

One sequence’s state for one recurrent layer.

Fields

conv: Vec<f32>

The conv window, [d_conv - 1][width], oldest row first (llama_hparams::n_embd_r).

ssm: Vec<f32>

The SSM state, [n_head][head_dim][d_state] (llama_hparams::n_embd_s).

Implementations

impl RecurrentState

pub fn zeros(conv_len: usize, ssm_len: usize) -> Self

A fresh sequence’s state: zeros, as build_rs zeroes a new sequence’s (llama-graph.cpp, llm_graph_input_rs).

pub fn bytes(&self) -> usize

Bytes this state holds.

Trait Implementations

impl Clone for RecurrentState

fn clone(&self) -> RecurrentState

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RecurrentState

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for RecurrentState

fn eq(&self, other: &RecurrentState) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for RecurrentState