Trait finalfusion::storage::Storage

source · 
pub trait Storage {
    // Required methods
    fn embedding(&self, idx: usize) -> CowArray<'_, f32, Ix1>;
    fn embeddings(&self, indices: &[usize]) -> Array2<f32>;
    fn shape(&self) -> (usize, usize);
}
Expand description

Embedding matrix storage.

To allow for embeddings to be stored in different manners (e.g. regular n x d matrix or as quantized vectors), this trait abstracts over concrete storage types.

Required Methods§

source

fn embedding(&self, idx: usize) -> CowArray<'_, f32, Ix1>

source

fn embeddings(&self, indices: &[usize]) -> Array2<f32>

Retrieve multiple embeddings.

source

fn shape(&self) -> (usize, usize)

Implementors§