pub struct GgufInfo {Show 14 fields
pub version: u32,
pub tensor_count: u64,
pub metadata_count: u64,
pub architecture: Option<String>,
pub quantization: Option<String>,
pub context_length: Option<u32>,
pub embedding_dim: Option<u32>,
pub num_layers: Option<u32>,
pub num_heads: Option<u32>,
pub vocab_size: Option<u32>,
pub parameters: Option<u64>,
pub name: Option<String>,
pub author: Option<String>,
pub license: Option<String>,
}Expand description
GGUF file information
Fields§
§version: u32GGUF version
tensor_count: u64Number of tensors
metadata_count: u64Number of metadata key-value pairs
architecture: Option<String>Model architecture (e.g., “llama”, “mistral”)
quantization: Option<String>Quantization type (e.g., “Q4_K_M”, “Q8_0”)
context_length: Option<u32>Context length
embedding_dim: Option<u32>Embedding dimension
num_layers: Option<u32>Number of layers
num_heads: Option<u32>Number of attention heads
vocab_size: Option<u32>Vocabulary size
parameters: Option<u64>Estimated parameter count
name: Option<String>Model name from metadata
Author from metadata
license: Option<String>License from metadata
Trait Implementations§
Source§impl<'de> Deserialize<'de> for GgufInfo
impl<'de> Deserialize<'de> for GgufInfo
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for GgufInfo
Auto Trait Implementations§
impl Freeze for GgufInfo
impl RefUnwindSafe for GgufInfo
impl Send for GgufInfo
impl Sync for GgufInfo
impl Unpin for GgufInfo
impl UnsafeUnpin for GgufInfo
impl UnwindSafe for GgufInfo
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more