Enum AttentionMask 

#[non_exhaustive]
pub enum AttentionMask<'a> {
    None,
    Causal,
    Array(&'a Array),
}

The mask of scaled_dot_product_attention.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

None

Every query attends to every key.

Causal

Query i attends to keys 0..=i + Lk - Lq (the queries are the last Lq positions).

Array(&'a Array)

A boolean mask (true attends) or an additive mask, broadcastable to [B, Hq, Lq, Lk].

Trait Implementations

impl<'a> Clone for AttentionMask<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for AttentionMask<'a>

impl<'a> Debug for AttentionMask<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'a> Default for AttentionMask<'a>

fn default() -> Self

Returns the “default value” for a type.

impl<'a> From<AttentionMask<'a>> for AttentionOptions<'a>

fn from(mask: AttentionMask<'a>) -> Self

Options with this mask and nothing else.