Enum PositionalEncodingType

pub enum PositionalEncodingType {
    Sinusoidal,
    Learned,
    Relative,
}

Types of positional encoding available

Variants

Sinusoidal

Sinusoidal positional encoding from the “Attention Is All You Need” paper

Learned

Learned positional embeddings, which are trained along with the model

Relative

Relative positional encoding that focuses on relative distances

Trait Implementations

impl Clone for PositionalEncodingType

fn clone(&self) -> PositionalEncodingType

Returns a duplicate of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PositionalEncodingType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for PositionalEncodingType

fn eq(&self, other: &PositionalEncodingType) -> bool

Tests for self and other values to be equal, and is used by ==.

const fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for PositionalEncodingType

impl StructuralPartialEq for PositionalEncodingType