pub struct TurboQuantTensor {
pub rows: usize,
pub cols: usize,
pub cache_lines: Vec<TurboQuantCacheLine64>,
}Expand description
High-level TurboQuant Tensor with Clifford Dyadic Versor Isometry.
Fields§
§rows: usize§cols: usize§cache_lines: Vec<TurboQuantCacheLine64>Implementations§
Source§impl TurboQuantTensor
impl TurboQuantTensor
Sourcepub fn compile_aot(
weights: &[f32],
rows: usize,
cols: usize,
versor: &DyadicWalshVersor,
) -> Self
pub fn compile_aot( weights: &[f32], rows: usize, cols: usize, versor: &DyadicWalshVersor, ) -> Self
Compiles an unquantized FP32 weight matrix into the AOT rotated TurboQuant representation.
Sourcepub fn matvec(&self, x: &[f32], out: &mut [f32], versor: &DyadicWalshVersor)
pub fn matvec(&self, x: &[f32], out: &mut [f32], versor: &DyadicWalshVersor)
Evaluates Matrix-Vector Product y = W * x using Dual Isometry with TurboQuant unbiased projection.
Trait Implementations§
Source§impl Clone for TurboQuantTensor
impl Clone for TurboQuantTensor
Auto Trait Implementations§
impl Forget for TurboQuantTensor
impl Freeze for TurboQuantTensor
impl Move for TurboQuantTensor
impl RefUnwindSafe for TurboQuantTensor
impl Send for TurboQuantTensor
impl Sync for TurboQuantTensor
impl Unpin for TurboQuantTensor
impl UnsafeUnpin for TurboQuantTensor
impl UnwindSafe for TurboQuantTensor
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more