pub struct AwqExpertOptions {
pub experts: usize,
pub expert_start: usize,
pub input_features: usize,
pub output_features: usize,
pub group_size: usize,
}Expand description
Explicit resident AWQ geometry and global expert range, without guessed source metadata.
Fields§
§experts: usizeActual expert matrices represented by original rank-three words/scales.
expert_start: usizeFirst global expert ID represented by this resident cube.
input_features: usizeOriginal per-expert input width.
output_features: usizeOriginal per-expert output width, divisible by eight.
group_size: usizeOriginal complete input-channel group size.
Trait Implementations§
Source§impl Clone for AwqExpertOptions
impl Clone for AwqExpertOptions
impl Copy for AwqExpertOptions
Source§impl Debug for AwqExpertOptions
impl Debug for AwqExpertOptions
impl Eq for AwqExpertOptions
Source§impl PartialEq for AwqExpertOptions
impl PartialEq for AwqExpertOptions
impl StructuralPartialEq for AwqExpertOptions
Auto Trait Implementations§
impl Freeze for AwqExpertOptions
impl RefUnwindSafe for AwqExpertOptions
impl Send for AwqExpertOptions
impl Sync for AwqExpertOptions
impl Unpin for AwqExpertOptions
impl UnsafeUnpin for AwqExpertOptions
impl UnwindSafe for AwqExpertOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.