Struct MmapDataset 

pub struct MmapDataset { /* private fields */ }

Memory-mapped dataset for zero-copy access

Implementations

impl MmapDataset

pub fn from_binary<P: AsRef<Path>>( path: P, n_samples: usize, n_features: usize, data_offset: usize, config: LazyLoadConfig, ) -> Result<Self>

Create a new memory-mapped dataset from a binary file

Arguments

• path - Path to the binary file
• n_samples - Number of samples in the dataset
• n_features - Number of features per sample
• data_offset - Byte offset to the start of data
• config - Lazy loading configuration

Returns

• Ok(MmapDataset) - The memory-mapped dataset
• Err(DatasetsError) - If mapping fails

pub fn n_samples(&self) -> usize

Get the number of samples

pub fn n_features(&self) -> usize

Get the number of features

pub fn view_range(&self, start: usize, end: usize) -> Result<Array2<f64>>

Get a zero-copy view of a sample range

Arguments

• start - Starting sample index
• end - Ending sample index (exclusive)

Returns

• Ok(Array2<f64>) - View of the requested samples
• Err(DatasetsError) - If range is invalid

pub fn adaptive_chunk_size(&self) -> usize

Calculate optimal chunk size based on memory pressure

pub fn iter_chunks(&self) -> LazyChunkIterator<'_>

Create an iterator over chunks with adaptive sizing