Struct LtxAttn 

pub struct LtxAttn<'a> {
    pub q: LtxLin<'a>,
    pub k: LtxLin<'a>,
    pub v: LtxLin<'a>,
    pub o: LtxLin<'a>,
    pub q_norm: &'a [f32],
    pub k_norm: &'a [f32],
    pub gate: Option<LtxLin<'a>>,
    pub heads: usize,
    pub dh: usize,
}

One attention of an LTX-2.5 block: the query reads the tokens, the keys and values read the context (the tokens again for self-attention), q and k take an RMS norm over the whole inner width, and every head’s output is scaled by 2 * sigmoid(gate(x)) where the block has gate logits.

Fields

q: LtxLin<'a>

k: LtxLin<'a>

v: LtxLin<'a>

o: LtxLin<'a>

q_norm: &'a [f32]

k_norm: &'a [f32]

gate: Option<LtxLin<'a>>

heads: usize

dh: usize

Trait Implementations

impl<'a> Clone for LtxAttn<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for LtxAttn<'a>