Enum SynthKind 

pub enum SynthKind {
    Codebook {
        entry_dim: u32,
        num_entries: u32,
    },
}

Weight-synthesis strategy for Op::SynthMatMul — how a compact stored representation is expanded into weight values inside the matmul inner loop (never materialized in DRAM), generalizing Op::DequantMatMul from fixed quant grids to learned functions.

Variants

Codebook

Single-level vector quantization with a learned codebook. The weight is stored transposed ([n, k], GGUF “bt” layout); each contiguous entry_dim-length sub-vector along the contraction axis k is replaced by a codebook centroid codebook[index] ∈ ℝ^{entry_dim}. num_entries centroids; indices are u8 (so num_entries ≤ 256). Requires k % entry_dim == 0.

Fields

entry_dim: u32

num_entries: u32

Trait Implementations

impl Clone for SynthKind

fn clone(&self) -> SynthKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SynthKind

impl Debug for SynthKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for SynthKind

fn deserialize<__D>( __deserializer: __D, ) -> Result<SynthKind, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for SynthKind

fn eq(&self, other: &SynthKind) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for SynthKind

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for SynthKind