Struct TimeEmbedding 

pub struct TimeEmbedding { /* private fields */ }

Time embedding module that produces sinusoidal embeddings.

Used to encode the transcription delay as a conditioning signal for the ADA RMSNorm modulation in the decoder layers.

Implementations

impl TimeEmbedding

pub fn new(dim: usize) -> Self

Create a new time embedding with given dimension.

pub fn with_theta(dim: usize, theta: f32) -> Self

Create a new time embedding with custom theta.

pub fn embed<B: Backend>(&self, t: f32, device: &B::Device) -> Tensor<B, 3>

Compute sinusoidal embedding for a time value.

Arguments

• t - Time value (typically the number of delay tokens)
• device - Device to create the tensor on

Returns

Tensor of shape [1, 1, dim] containing the sinusoidal embedding

Trait Implementations

impl Debug for TimeEmbedding

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.