Struct GgufSource 

pub struct GgufSource { /* private fields */ }

A parsed GGUF file.

Implementations

impl GgufSource

pub fn load(path: impl AsRef<Path>) -> Result<Self>

Opens and parses a .gguf file.

impl GgufSource

pub fn eos_token_ids(&self) -> &[u32]

End-of-sequence ids from tokenizer metadata.

pub fn path(&self) -> &Path

Model file path.

Trait Implementations

impl ModelSource for GgufSource

fn metadata(&self) -> &ModelMetadata

Architecture + hyperparameter metadata.

fn tensor_names(&self) -> Vec<String>

Names of all tensors available in this source.

fn open_tensor(&self, name: &str) -> Result<TensorReader<'_>>

Opens a tensor by name, returning a lazy reader over the raw bytes.

fn tokenizer(&self) -> Result<TokenizerSpec>

Tokenizer specification (path to tokenizer.json + added tokens).

fn sampler_defaults(&self) -> Option<SamplerConfig>

Sampler defaults from generation_config.json, if present.