Skip to main content

Module native

Module native 

Source
Expand description

vNext physical GGUF source. The validated native descriptor table retains file type IDs, including IQ types absent from Candle’s QTensor enum. Model semantics and tokenizer metadata remain in their independently bound sources.

Structs§

NativeGgufFile
NativeGgufTensor

Functions§

gguf_weight_encoding
Describes physical bytes only. An accepted encoding does not imply that an operation provider exists for any particular device or model tensor role.