Struct Data2VecModel 

pub struct Data2VecModel { /* private fields */ }

Struct-based Data2Vec model that owns student encoder layers and a teacher EMA state.

Student weights per layer are stored as:

• student_w[l] — [d_model × d_model] weight matrix (row-major).
• student_b[l] — [d_model] bias vector.

Teacher weights are stored flat in Data2VecState::teacher_params in the same sequential layout (w0, b0, w1, b1, …).

Implementations

impl Data2VecModel

pub fn new(config: Data2VecModelConfig, rng: &mut LcgRng) -> SslResult<Self>

Create a new Data2VecModel with Kaiming-initialised student layers and a teacher state cloned from the initial student parameters.

Errors

• SslError::InvalidParameter when d_model == 0.
• SslError::InvalidParameter when n_layers == 0.

pub fn encode_student(&self, x: &[f32], n_patches: usize) -> SslResult<Vec<f32>>

Encode a sequence of patch embeddings with the student encoder.

Each layer applies: token ← ReLU(W · token + b) independently per token.

Arguments

• x — flat [n_patches × d_model] input (row-major).
• n_patches — number of tokens in the sequence.

Errors

SslError::DimensionMismatch when x.len() != n_patches * d_model.

pub fn encode_teacher(&self, x: &[f32], n_patches: usize) -> SslResult<Vec<f32>>

Encode a sequence of patch embeddings with the teacher encoder.

Uses the teacher weight matrices stored in Data2VecState::teacher_params.

Arguments

• x — flat [n_patches × d_model] input (row-major).
• n_patches — number of tokens in the sequence.

Errors

SslError::DimensionMismatch when x.len() != n_patches * d_model.

pub fn loss(&self, x: &[f32], mask: &[bool], n_patches: usize) -> SslResult<f32>

Compute the Data2Vec loss for a masked input.

1. Encodes with the student encoder → student_repr [n_patches × d_model].
2. Encodes with the teacher encoder → teacher_repr [n_patches × d_model].
3. Computes Huber loss at masked positions via data2vec_loss.

Arguments

• x — flat [n_patches × d_model] input.
• mask — [n_patches] boolean; true = masked position.
• n_patches — number of tokens.

Errors

Propagates dimension and config errors.

pub fn ema_update(&mut self) -> SslResult<()>

Apply the EMA update: teacher ← ema_decay · teacher + (1 − ema_decay) · student.

Errors

• SslError::InvalidMomentum when ema_decay is not in [0, 1].
• SslError::DimensionMismatch when param shapes mismatch (should not occur in normal usage).

pub fn d_model(&self) -> usize

Return the token/patch embedding dimension.

Trait Implementations

impl Clone for Data2VecModel

fn clone(&self) -> Data2VecModel

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Data2VecModel

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.