Struct BnbNestedState 

pub struct BnbNestedState {
    pub block_size: usize,
    pub offset: f32,
}

The JSON-carried half of bitsandbytes double quantization. The other half (nested_absmax, nested_quant_map) is stored as separate safetensors tensors, not in the JSON blob.

Fields

block_size: usize

Number of first-level absmax codes sharing one second-level scale (bnb’s default is 256).

offset: f32

Mean of the first-level absmax, added back after dequantization.

Trait Implementations

impl Clone for BnbNestedState

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BnbNestedState

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for BnbNestedState

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for BnbNestedState