Enum AttentionType 

pub enum AttentionType {
    Mha,
    Gqa,
    Mqa,
    Ssm,
    Linear,
}

Attention mechanism type

Variants

Mha

Multi-Head Attention (standard transformer)

Gqa

Grouped Query Attention (GQA)

Mqa

Multi-Query Attention (MQA)

Ssm

State Space Model (no attention — selective scan)

Linear

Linear Attention (WKV recurrence, no softmax)

Implementations

impl AttentionType

pub fn from_str_contract(s: &str) -> Result<AttentionType, AprenderError>

Parse from YAML string

Trait Implementations

impl Clone for AttentionType

fn clone(&self) -> AttentionType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for AttentionType

impl Debug for AttentionType

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Display for AttentionType

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Eq for AttentionType

impl PartialEq for AttentionType

fn eq(&self, other: &AttentionType) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for AttentionType