Struct RotaryEncodingConfig

pub struct RotaryEncodingConfig {
    pub max_sequence_length: usize,
    pub d_model: usize,
    pub theta: f32,
}

Configuration to create a RotaryEncoding layer using the init function.

Fields

max_sequence_length: usize

Maximum sequence length of input

d_model: usize

Size of the input embedding or hidden dimension

theta: f32

Scaling factor for frequency computation. Defaults to 10000.0

Implementations

impl RotaryEncodingConfig

pub fn new(max_sequence_length: usize, d_model: usize) -> Self

Create a new instance of the config.

impl RotaryEncodingConfig

pub fn with_theta(self, theta: f32) -> Self

Scaling factor for frequency computation. Defaults to 10000.0

impl RotaryEncodingConfig

pub fn init<B: Backend>(&self, device: &B::Device) -> RotaryEncoding<B>

Initialize a new RotaryEncoding module.

Panics

Panics if the size of input embedding dimension is not even. Panics if the theta parameter is not positive.

pub fn init_with_frequency_scaling<B: Backend>( &self, scaling: impl Fn(Tensor<B, 1>) -> Tensor<B, 1>, device: &B::Device, ) -> RotaryEncoding<B>

Initialize a new RotaryEncoding module with a custom frequency scaling function. This is useful to apply different RoPE extensions.

Panics

Panics if the size of input embedding dimension is not even. Panics if the theta parameter is not positive.

Trait Implementations

impl Clone for RotaryEncodingConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Config for RotaryEncodingConfig

fn save<P: AsRef<Path>>(&self, file: P) -> Result<()>

Available on crate feature std only.

Saves the configuration to a file.

fn load<P: AsRef<Path>>(file: P) -> Result<Self, ConfigError>

Available on crate feature std only.

Loads the configuration from a file.

fn load_binary(data: &[u8]) -> Result<Self, ConfigError>

Loads the configuration from a binary buffer.

impl Debug for RotaryEncodingConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for RotaryEncodingConfig

fn deserialize<D>(deserializer: D) -> Result<Self, D::Error>

where D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for RotaryEncodingConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Serialize for RotaryEncodingConfig

fn serialize<S>(&self, serializer: S) -> Result<S::Ok, S::Error>

where S: Serializer,

Serialize this value into the given Serde serializer.