Trait finalfusion::io::MmapEmbeddings

pub trait MmapEmbeddingswhere
    Self: Sized,{
    // Required method
    fn mmap_embeddings(read: &mut BufReader<File>) -> Result<Self>;
}

Memory-map finalfusion embeddings.

This trait is used to read finalfusion embeddings while memory mapping the embedding matrix. This leads to considerable memory savings, since the operating system will load the relevant pages from disk on demand.

Required Methods

fn mmap_embeddings(read: &mut BufReader<File>) -> Result<Self>

Object Safety

This trait is not object safe.

Implementors

impl<V, S> MmapEmbeddings for Embeddings<V, S>where Self: Sized, V: ReadChunk, S: MmapChunk,