Struct IOStats 

pub struct IOStats {
    pub total_flops: u64,
    pub memory_reads: u64,
    pub memory_writes: u64,
    /* private fields */
}

IO statistics for comparing tiled vs naive attention.

Fields

total_flops: u64

Total floating-point operations performed.

memory_reads: u64

Total elements read from main memory.

memory_writes: u64

Total elements written to main memory.

Implementations

impl IOStats

pub fn flop_ratio(&self) -> f32

Returns the ratio of naive FLOPs to tiled FLOPs (should be ~1.0 since FLOPs are the same; the advantage is in memory IO).

pub fn memory_complexity(&self) -> &'static str

Returns the memory complexity class as a string. Tiled: O(N) working memory. Naive: O(N^2).

pub fn naive_memory_complexity(&self) -> &'static str

Returns the naive attention memory complexity for comparison.

Trait Implementations

impl Clone for IOStats

fn clone(&self) -> IOStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for IOStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for IOStats

fn default() -> IOStats

Returns the “default value” for a type.