pub struct ExpertQuantization {
pub bits: usize,
pub block_size: usize,
pub blocks_per_row: usize,
}Expand description
Quantization geometry needed to interpret one expert’s packed tensor slice.
Fields§
§bits: usizeNumber of quantized weight bits per logical value.
block_size: usizeNumber of logical input values sharing one scale/zero-point block.
blocks_per_row: usizeNumber of quantization blocks represented by each tensor row.
Trait Implementations§
Source§impl Clone for ExpertQuantization
impl Clone for ExpertQuantization
Source§fn clone(&self) -> ExpertQuantization
fn clone(&self) -> ExpertQuantization
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for ExpertQuantization
Source§impl Debug for ExpertQuantization
impl Debug for ExpertQuantization
impl Eq for ExpertQuantization
Source§impl PartialEq for ExpertQuantization
impl PartialEq for ExpertQuantization
impl StructuralPartialEq for ExpertQuantization
Auto Trait Implementations§
impl Freeze for ExpertQuantization
impl RefUnwindSafe for ExpertQuantization
impl Send for ExpertQuantization
impl Sync for ExpertQuantization
impl Unpin for ExpertQuantization
impl UnsafeUnpin for ExpertQuantization
impl UnwindSafe for ExpertQuantization
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more