pub struct ExpertQuantization {
pub bits: usize,
pub block_size: usize,
pub blocks_per_row: usize,
}Expand description
Quantization geometry needed to interpret one expert’s packed tensor slice.
Fields§
§bits: usizeNumber of quantized weight bits per logical value.
block_size: usizeNumber of logical input values sharing one scale/zero-point block.
blocks_per_row: usizeNumber of quantization blocks represented by each tensor row.
Trait Implementations§
Source§impl Clone for ExpertQuantization
impl Clone for ExpertQuantization
Source§fn clone(&self) -> ExpertQuantization
fn clone(&self) -> ExpertQuantization
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for ExpertQuantization
Source§impl Debug for ExpertQuantization
impl Debug for ExpertQuantization
impl Eq for ExpertQuantization
Source§impl PartialEq for ExpertQuantization
impl PartialEq for ExpertQuantization
impl StructuralPartialEq for ExpertQuantization
Auto Trait Implementations§
impl Freeze for ExpertQuantization
impl RefUnwindSafe for ExpertQuantization
impl Send for ExpertQuantization
impl Sync for ExpertQuantization
impl Unpin for ExpertQuantization
impl UnsafeUnpin for ExpertQuantization
impl UnwindSafe for ExpertQuantization
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.