Skip to main content

ROW_INDEPENDENT_ROWS

Constant ROW_INDEPENDENT_ROWS 

Source
pub const ROW_INDEPENDENT_ROWS: usize = 8;
Expand description

Products with at most this many rows give each row the bits of the same row’s one-row product: dense matrix products in float32, float16 and bfloat16 always, and quantized and gathered (mixture-of-experts) products evaluated under with_row_exact. See the nuvec crate’s “Determinism” section.