Struct SlidingWindowStats 

pub struct SlidingWindowStats {
    pub config: SlidingWindowConfig,
    pub complexity_reduction: f64,
    pub memory_reduction: f64,
}

Statistics for Sliding Window Attention

Fields

config: SlidingWindowConfig

Configuration

complexity_reduction: f64

Complexity reduction for given sequence length

memory_reduction: f64

Memory reduction for given sequence length

Implementations

impl SlidingWindowStats

pub fn from_config(config: &SlidingWindowConfig, seq_len: usize) -> Self

Create stats from configuration and sequence length

pub fn summary(&self, seq_len: usize) -> String

Format as a summary string

Trait Implementations

impl Clone for SlidingWindowStats

fn clone(&self) -> SlidingWindowStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SlidingWindowStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.