Struct GgufContext 

pub struct GgufContext { /* private fields */ }

A safe wrapper around gguf_context.

Opens a GGUF file and parses only the metadata header; tensor weights are never loaded into memory (no_alloc = true).

Implementations

impl GgufContext

pub fn from_file(path: &Path) -> Option<Self>

Open a GGUF file and parse its metadata header.

Returns None if the path contains a null byte, the file does not exist, or the file is not a valid GGUF file.

pub fn n_kv(&self) -> i64

Total number of key-value pairs in the metadata.

pub fn find_key(&self, key: &str) -> i64

Find the index of a key by name. Returns -1 if not found.

pub fn key_at(&self, idx: i64) -> Option<&str>

Return the key name at the given index, or None if out of range.

pub fn kv_type(&self, idx: i64) -> gguf_type

Return the value type of the KV pair at idx.

pub fn val_u32(&self, idx: i64) -> u32

Read a uint32 value. Panics (inside llama.cpp) if the stored type is not GGUF_TYPE_UINT32 — check kv_type first if unsure.

pub fn val_i32(&self, idx: i64) -> i32

Read an int32 value.

pub fn val_u64(&self, idx: i64) -> u64

Read a uint64 value.

pub fn val_str(&self, idx: i64) -> Option<&str>

Read a string value. Returns None if the pointer is null or not valid UTF-8.

pub fn n_tensors(&self) -> i64

Total number of tensors described in the file.

Trait Implementations

impl Debug for GgufContext

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for GgufContext

fn drop(&mut self)

Executes the destructor for this type.