Struct candle_core::safetensors::MmapedSafetensors

pub struct MmapedSafetensors { /* private fields */ }

Implementations

impl MmapedSafetensors

pub unsafe fn new<P: AsRef<Path>>(p: P) -> Result<Self>

Creates a wrapper around a memory mapped file and deserialize the safetensors header.

Safety

The unsafe is inherited from memmap2::MmapOptions.

pub unsafe fn multi<P: AsRef<Path>>(paths: &[P]) -> Result<Self>

Creates a wrapper around multiple memory mapped file and deserialize the safetensors headers.

If a tensor name appears in multiple files, the last entry is returned.

Safety

The unsafe is inherited from memmap2::MmapOptions.

pub fn load(&self, name: &str, dev: &Device) -> Result<Tensor>

pub fn tensors(&self) -> Vec<(String, TensorView<'_>)>

pub fn get(&self, name: &str) -> Result<TensorView<'_>>