Struct SinusoidalPositionEncoding 

pub struct SinusoidalPositionEncoding {
    pub config: PositionEncodingConfig,
}

Sinusoidal position encoding

Fields

config: PositionEncodingConfig

Configuration

Implementations

impl SinusoidalPositionEncoding

pub fn new(config: PositionEncodingConfig) -> Result<Self>

Create a new sinusoidal position encoding

pub fn build_encoding_graph( &self, graph: &mut EinsumGraph, ) -> Result<Vec<usize>>

Build einsum graph for sinusoidal position encoding

Input tensors:

• 0: x (input) [batch, seq_len, d_model]
• 1: position_ids [batch, seq_len] (optional, will use 0..seq_len if not provided)

Output tensors:

• output: [batch, seq_len, d_model] (x + position_encoding)

pub fn base(&self) -> f64

Get the base frequency for encoding

Trait Implementations

impl Clone for SinusoidalPositionEncoding

fn clone(&self) -> SinusoidalPositionEncoding

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SinusoidalPositionEncoding

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.