Enum AttentionIOForm 

#[repr(i32)]
pub enum AttentionIOForm {
    kPADDED_BHND = 0,
    kPACKED_NHD = 1,
}

AttentionIOForm

Enumerates the layout of the input/output tensors in an Attention layer.

Variants

kPADDED_BHND = 0

All batches padded to maximum length. Shape: [batch_size, num_heads, num_tokens, head_dim]

kPACKED_NHD = 1

All batches concatenated without padding. Shape: [total_tokens, num_heads, head_dim]

Trait Implementations

impl Clone for AttentionIOForm

fn clone(&self) -> AttentionIOForm

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Eq for AttentionIOForm

impl ExternType for AttentionIOForm

type Id = (n, v, i, n, f, e, r, _1, (), A, t, t, e, n, t, i, o, n, I, O, F, o, r, m)

A type-level representation of the type’s C++ namespace and type name.

type Kind = Trivial

Either cxx::kind::Opaque or cxx::kind::Trivial.

impl From<AttentionIOForm> for AttentionIOForm

fn from(value: AttentionIOForm) -> Self

Converts to this type from the input type.

impl Hash for AttentionIOForm

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Into<AttentionIOForm> for AttentionIOForm

fn into(self) -> AttentionIOForm

Converts this type into the (usually inferred) input type.

impl PartialEq for AttentionIOForm

fn eq(&self, other: &AttentionIOForm) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl SharedPtrTarget for AttentionIOForm

impl StructuralPartialEq for AttentionIOForm

impl UniquePtrTarget for AttentionIOForm

impl VectorElement for AttentionIOForm

impl WeakPtrTarget for AttentionIOForm