Skip to main content

export_disk_bytes

Function export_disk_bytes 

Source
pub fn export_disk_bytes(params: u64, merge: bool, quantize: &str) -> u64
Expand description

The disk an export of a model of params parameters to quantize needs beside the run’s own files, in bytes: when merge, the base model in the Hugging Face cache and the merged copy (bf16, 2 bytes per parameter each); the 16-bit GGUF the quantization starts from, unless quantize is F16 or BF16; and the GGUF itself. Raised by 10%.