Enum Decay 

pub enum Decay<'a> {
    PerHead(&'a [f32]),
    PerState(&'a [f32]),
}

The stored A, in the two shapes the kernel takes.

Variants

PerHead(&'a [f32])

Mamba-2: [n_head], {1, n_head} in ggml; dA is one scalar per head.

PerState(&'a [f32])

Mamba-1: [n_head][d_state], {d_state, n_head} in ggml; dA is one scalar per state element.

Trait Implementations

impl<'a> Clone for Decay<'a>

fn clone(&self) -> Decay<'a>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for Decay<'a>

impl<'a> Debug for Decay<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.