Struct SafetensorsSource 

pub struct SafetensorsSource { /* private fields */ }

ModelSource over a HuggingFace-format directory:

<dir>/config.json                   (required)
<dir>/generation_config.json        (optional)
<dir>/tokenizer.json                (required by the runtime)
<dir>/tokenizer_config.json         (optional; chat special tokens)
<dir>/model.safetensors             (single-file), or
<dir>/model.safetensors.index.json  (sharded)

Files are memory-mapped; ModelSource::open_tensor returns zero-copy views into the mapping.

Implementations

impl SafetensorsSource

pub fn load(dir: impl AsRef<Path>) -> Result<Self>

Opens a model directory (see type docs for the expected layout).

Trait Implementations

impl ModelSource for SafetensorsSource

fn metadata(&self) -> &ModelMetadata

Architecture + hyperparameter metadata.

fn tensor_names(&self) -> Vec<String>

Names of all tensors available in this source.

fn open_tensor(&self, name: &str) -> Result<TensorReader<'_>>

Opens a tensor by name, returning a lazy reader over the raw bytes.

fn tokenizer(&self) -> Result<TokenizerSpec>

Tokenizer specification (path to tokenizer.json + added tokens).

fn sampler_defaults(&self) -> Option<SamplerConfig>

Sampler defaults from generation_config.json, if present.