Struct StateSnapshot 

pub struct StateSnapshot {
    pub layers: Vec<LayerSnapshot>,
    pub seq_len: usize,
    pub anchor_depth: u32,
    pub boundary_kind: u8,
    pub semantic_hash: u64,
    pub shift_offset: u32,
}

Snapshot of model KV + conv state after prefilling a token sequence. Backend-agnostic: stores raw bytes that the backend knows how to restore.

Fields

layers: Vec<LayerSnapshot>

seq_len: usize

anchor_depth: u32

boundary_kind: u8

semantic_hash: u64

shift_offset: u32

Implementations

impl StateSnapshot

pub fn new(layers: Vec<LayerSnapshot>, seq_len: usize) -> Self

pub fn with_anchor( self, depth: u32, kind: SemanticBoundaryKind, semantic_hash: u64, ) -> Self

pub fn with_shift_offset(self, shift: u32) -> Self

impl StateSnapshot

pub fn byte_size(&self) -> usize

pub fn is_compressed(&self) -> bool

true iff any attention layer in this snapshot is compressed. Used by Lfm2Model::forward_prefill to skip snapshots whose compression mode doesn’t match the live state — treat as cache miss instead of panicking on restore.

pub fn is_f16(&self) -> bool

true iff any attention layer in this snapshot is f16 (AttentionF16). Used by Lfm2Model::forward_prefill’s cross-mode gate to reject an f16 snapshot against an f32 (or compressed) live state — their byte widths differ, so a cross-mode restore would corrupt the cache.

Trait Implementations

impl Clone for StateSnapshot

fn clone(&self) -> StateSnapshot

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for StateSnapshot

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.