Struct MmapManager 

pub struct MmapManager { /* private fields */ }

Memory-mapped embedding manager with dirty tracking and prefetching.

Manages large embedding matrices that may not fit in RAM using memory-mapped files. Tracks which embeddings have been accessed and modified for efficient I/O.

Implementations

impl MmapManager

pub fn new(path: &Path, d_embed: usize, max_nodes: usize) -> Result<Self>

Create a new memory-mapped embedding manager.

Arguments

• path - Path to the memory-mapped file
• d_embed - Embedding dimension
• max_nodes - Maximum number of nodes to support

Returns

A new MmapManager instance

pub fn embedding_offset(&self, node_id: u64) -> Option<usize>

Calculate the byte offset for a given node’s embedding.

Arguments

• node_id - Node identifier

Returns

Byte offset in the memory-mapped file, or None if overflow would occur

Security

Uses checked arithmetic to prevent integer overflow attacks.

pub fn get_embedding(&self, node_id: u64) -> &[f32]

Get a read-only reference to a node’s embedding.

Arguments

• node_id - Node identifier

Returns

Slice containing the embedding vector

Panics

Panics if node_id is out of bounds or would cause overflow

pub fn set_embedding(&mut self, node_id: u64, data: &[f32])

Set a node’s embedding data.

Arguments

• node_id - Node identifier
• data - Embedding vector to write

Panics

Panics if node_id is out of bounds, data length doesn’t match d_embed, or offset calculation would overflow.

pub fn flush_dirty(&self) -> Result<()>

Flush all dirty pages to disk.

Returns

Ok(()) on success, error otherwise

pub fn prefetch(&self, node_ids: &[u64])

Prefetch embeddings into memory for better cache locality.

Arguments

• node_ids - List of node IDs to prefetch

pub fn d_embed(&self) -> usize

Get the embedding dimension.

pub fn max_nodes(&self) -> usize

Get the maximum number of nodes.

Trait Implementations

impl Debug for MmapManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for MmapManager

fn drop(&mut self)

Executes the destructor for this type.