Struct TokenEmbedding 

pub struct TokenEmbedding {
    pub vocab_size: usize,
    pub embed_dim: usize,
    pub weight: WeightTensor,
}

Token embedding table: maps token ids to dense vectors.

Weight shape: [vocab_size × embed_dim]. Output shape: [seq_len × embed_dim].

Fields

vocab_size: usize

Vocabulary size.

embed_dim: usize

Embedding dimension.

weight: WeightTensor

Weight table: [vocab_size × embed_dim], row-major.

Implementations

impl TokenEmbedding

pub fn new(vocab_size: usize, embed_dim: usize) -> LmResult<Self>

Construct with zero-initialised weights.

pub fn from_weight(weight: WeightTensor) -> LmResult<Self>

Construct from an existing weight tensor.

pub fn forward(&self, token_ids: &[u32]) -> LmResult<Vec<f32>>

Lookup embeddings for token_ids.

Returns a flat buffer of shape [token_ids.len() × embed_dim].

Trait Implementations

impl Clone for TokenEmbedding

fn clone(&self) -> TokenEmbedding

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenEmbedding

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.