Struct VaeAttnRef 

pub struct VaeAttnRef<'a> {
    pub norm: VaeNormRef<'a>,
    pub q: (&'a [f32], &'a [f32]),
    pub k: (&'a [f32], &'a [f32]),
    pub v: (&'a [f32], &'a [f32]),
    pub out: (&'a [f32], &'a [f32]),
    pub c: usize,
}

The mid-block single-head spatial attention: GroupNorm, then token-major q/k/v Linear [c, c] (row-major out×in) + bias, softmax(q·kᵀ/√c)·v, out Linear + bias, residual add onto the block input.

Fields

norm: VaeNormRef<'a>

q: (&'a [f32], &'a [f32])

k: (&'a [f32], &'a [f32])

v: (&'a [f32], &'a [f32])

out: (&'a [f32], &'a [f32])

c: usize

Trait Implementations

impl<'a> Clone for VaeAttnRef<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for VaeAttnRef<'a>