Struct Embedding 

pub struct Embedding<E> { /* private fields */ }

The embedding lookup table.gather(selection): one [vocab, dim] parameter behind the gather that is the whole formula.

The input is a one-hot [count, vocab] selection — feed a Tensor::selection as a per-run input so one recorded graph serves any batch of indices — and the output is the selected [count, dim] rows. Layout beyond the lookup (concatenating a context window, adding a position table) stays with the caller; a position table is simply a second Embedding.

Tying goes through the exposed table symbol, like Linear::weights: a tied language-model head is a matmul with the resolved table, not a second module.

Implementations

impl<E: Element> Embedding<E>

pub fn new(tape: &Tape<E>, table: Tensor<E>) -> Self

Allocates the [vocab, dim] table on tape from its initial payload and returns the module. Callers own initialization; the module records whatever it is given.

Panics

Panics if table is not rank 2.

pub fn table(&self) -> Symbol

Returns the symbol of the [vocab, dim] table.

pub fn parameters(&self) -> impl Iterator<Item = Symbol> + '_

Returns the symbols of the module’s parameters: the table.

Trait Implementations

impl<E: Clone> Clone for Embedding<E>

fn clone(&self) -> Embedding<E>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<E: Debug> Debug for Embedding<E>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<E: Element> Module<E> for Embedding<E>

fn express<'tape>(&self, input: Value<'tape, E>) -> Value<'tape, E>

Records the lookup of the one-hot [count, vocab] input and returns the selected [count, dim] rows.

Panics

Panics if the table is not allocated on the input’s tape, or if the gather’s shapes disagree.

fn visit(&self, visitor: &mut dyn Visitor)

Walks this module’s parameters and children in a stable order, announcing each parameter under its local name and each child under a path segment. Stateless modules do nothing, which is the default.