Struct RotaryEmbedding 

pub struct RotaryEmbedding { /* private fields */ }

Rotary position embedding.

Applies rotary embeddings to query and key tensors for position encoding.

Implementations

impl RotaryEmbedding

pub fn new( head_dim: usize, max_seq_len: usize, base: f32, device: &Device, ) -> Result<RotaryEmbedding, UnslothError>

Create rotary embeddings.

Arguments

• head_dim - Dimension per attention head
• max_seq_len - Maximum sequence length to cache
• base - Base for frequency computation (typically 10000)
• device - Device for tensors

pub fn forward( &self, q: &Tensor, k: &Tensor, _position_ids: &Tensor, ) -> Result<(Tensor, Tensor), UnslothError>

Apply rotary embedding to query and key tensors.

Arguments

• q - Query tensor [batch, num_heads, seq_len, head_dim]
• k - Key tensor [batch, num_kv_heads, seq_len, head_dim]
• position_ids - Position indices [batch, seq_len]

Returns

Tuple of (rotated_q, rotated_k)