Struct QueryKeyRotaryEmbeddingsConfig

pub struct QueryKeyRotaryEmbeddingsConfig { /* private fields */ }

Configuration for query-key rotary embeddings.

Implementations

impl QueryKeyRotaryEmbeddingsConfig

pub fn build( &self, vb: VarBuilder<'_>, ) -> Result<QueryKeyRotaryEmbeddings, QueryKeyRotaryEmbeddingsError>

Build query-key rotary embeddings

pub fn base(self, base: usize) -> Self

Base used for theta.

This determines the cycle length of the embeddings.

Default: 10_000

pub fn fraction(self, fraction: f32) -> Self

Fraction of the hidden width to apply rotary embeddings to.

Must be in [0,1].

Default: 1.0

pub fn head_width(self, head_width: usize) -> Self

Head width for query and key attention.

Default: 96

pub fn seq_len(self, seq_len: usize) -> Self

Number of positions to precompute rotary embeddings for.

The internal data structures will be resized if a longer sequence is encountered.

Default: 2048

Trait Implementations

impl Clone for QueryKeyRotaryEmbeddingsConfig

fn clone(&self) -> QueryKeyRotaryEmbeddingsConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QueryKeyRotaryEmbeddingsConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for QueryKeyRotaryEmbeddingsConfig

fn default() -> Self

Returns the “default value” for a type.