pub struct PositionalEncoding {
pub max_seq_len: usize,
pub encoding_dim: usize,
pub encodings: AttentionMatrix,
}Expand description
Sinusoidal positional encoding table (Vaswani et al. 2017).
PE[pos][2i] = sin(pos / 10000^(2i/d))
PE[pos][2i+1] = cos(pos / 10000^(2i/d))
Fields§
§max_seq_len: usizeMaximum sequence length supported.
encoding_dim: usizeDimensionality of the encoding vectors (= model_dim).
encodings: AttentionMatrixPre-computed encoding table — shape max_seq_len × encoding_dim.
Implementations§
Trait Implementations§
Source§impl Clone for PositionalEncoding
impl Clone for PositionalEncoding
Source§fn clone(&self) -> PositionalEncoding
fn clone(&self) -> PositionalEncoding
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for PositionalEncoding
impl RefUnwindSafe for PositionalEncoding
impl Send for PositionalEncoding
impl Sync for PositionalEncoding
impl Unpin for PositionalEncoding
impl UnsafeUnpin for PositionalEncoding
impl UnwindSafe for PositionalEncoding
Blanket Implementations§
impl<T> Allocation for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more