Enum CausalMaskKind 

#[repr(i32)]
pub enum CausalMaskKind {
    kNONE = 0,
    kUPPER_LEFT = 1,
    kLOWER_RIGHT = 2,
}

CausalMaskKind

Enumerates the causal mask alignment orientation for the attention.

When s_q == s_kv, both kUPPER_LEFT and kLOWER_RIGHT produce identical triangular masks. When s_q != s_kv (e.g., during LLM generation where s_q=1 and s_kv grows):

• kUPPER_LEFT: Diagonal anchored at top-left corner (j <= i). Query tokens attend only to the earliest cache positions.
• kLOWER_RIGHT: Diagonal anchored at bottom-right corner (j <= i + (s_kv - s_q)). Query tokens attend to all preceding context, which is the correct behavior for autoregressive generation.

See [IAttention::setCausalKind()], IAttention::getCausalKind()

Variants

kNONE = 0

No causal masking applied.

kUPPER_LEFT = 1

Diagonal anchored at top-left corner (legacy default when causal=true).

kLOWER_RIGHT = 2

Diagonal anchored at bottom-right corner (decode-aligned semantics).

Trait Implementations

impl Clone for CausalMaskKind

fn clone(&self) -> CausalMaskKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Eq for CausalMaskKind

impl ExternType for CausalMaskKind

type Id = (n, v, i, n, f, e, r, _1, (), C, a, u, s, a, l, M, a, s, k, K, i, n, d)

A type-level representation of the type’s C++ namespace and type name.

type Kind = Trivial

Either cxx::kind::Opaque or cxx::kind::Trivial.

impl From<CausalMaskKind> for CausalMaskKind

fn from(value: CausalMaskKind) -> Self

Converts to this type from the input type.

impl Hash for CausalMaskKind

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Into<CausalMaskKind> for CausalMaskKind

fn into(self) -> CausalMaskKind

Converts this type into the (usually inferred) input type.

impl PartialEq for CausalMaskKind

fn eq(&self, other: &CausalMaskKind) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl SharedPtrTarget for CausalMaskKind

impl StructuralPartialEq for CausalMaskKind

impl UniquePtrTarget for CausalMaskKind

impl VectorElement for CausalMaskKind

impl WeakPtrTarget for CausalMaskKind