Enum LazyDataSource 

pub enum LazyDataSource {
    Zip(Arc<Mutex<ZipSource>>),
    LegacyMultiStorage(Arc<Mutex<LegacyMultiStorageSource>>),
}

A data source that can lazily load tensor data.

Variants

Zip(Arc<Mutex<ZipSource>>)

ZIP archive with lazy loading

LegacyMultiStorage(Arc<Mutex<LegacyMultiStorageSource>>)

Legacy format with multiple storages in single blob

Implementations

impl LazyDataSource

pub fn from_zip(path: impl AsRef<Path>) -> Result<Self>

Create from a ZIP file

pub fn from_legacy_multi_storage( path: impl AsRef<Path>, data_offset: u64, data_size: u64, ) -> Self

Create from a legacy multi-storage file

pub fn read(&self, key: &str) -> Result<Vec<u8>>

Read data for a specific key

pub fn read_range( &self, key: &str, offset: usize, length: usize, ) -> Result<Vec<u8>>

Read a portion of data for a specific key

pub fn contains(&self, key: &str) -> bool

Check if a key exists

pub fn keys(&self) -> Vec<String>

Get list of available keys (for ZIP sources)

Trait Implementations

impl Clone for LazyDataSource

fn clone(&self) -> LazyDataSource

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.