Struct RotaryEmbedding 

pub struct RotaryEmbedding<B: Backend> { /* private fields */ }

Precomputed RoPE cosine/sine tables.

Frequencies: inv_freq[i] = theta^(-2i / head_dim) for i in 0..head_dim/2. Tables are [max_position, head_dim] with the half-dim frequencies duplicated (cat([cos, cos])) to match the half-split convention (config.rope_interleaved = false, the HF Llama default).

Implementations

impl<B: Backend> RotaryEmbedding<B>

pub fn new( head_dim: usize, theta: f64, max_position: usize, device: &Device<B>, ) -> Self

Builds tables on device (no frequency scaling).

pub fn new_scaled( head_dim: usize, theta: f64, max_position: usize, scaling: &RopeScaling, device: &Device<B>, ) -> Self

Builds tables on device with RoPE frequency scaling applied.

pub fn apply(&self, x: Tensor<B, 4>, pos: usize) -> Tensor<B, 4>

Applies RoPE to a [batch, heads, seq, head_dim] tensor whose first sequence position is at absolute position pos.