pub struct ExpertTensorLayout {
pub version: u32,
pub experts: usize,
pub rows_per_expert: usize,
pub storage_elements_per_row: usize,
pub order: ExpertStorageOrder,
pub quantization: Option<ExpertQuantization>,
}Expand description
Compact layout descriptor used to derive expert byte ranges.
Fields§
§version: u32Mandatory layout contract version. Phase 1 supports version 1.
experts: usize§rows_per_expert: usize§storage_elements_per_row: usizeStored elements per row (packed bytes for a Uint8 weight tensor).
order: ExpertStorageOrder§quantization: Option<ExpertQuantization>Trait Implementations§
Source§impl Clone for ExpertTensorLayout
impl Clone for ExpertTensorLayout
Source§fn clone(&self) -> ExpertTensorLayout
fn clone(&self) -> ExpertTensorLayout
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ExpertTensorLayout
impl Debug for ExpertTensorLayout
impl Eq for ExpertTensorLayout
Source§impl PartialEq for ExpertTensorLayout
impl PartialEq for ExpertTensorLayout
impl StructuralPartialEq for ExpertTensorLayout
Auto Trait Implementations§
impl Freeze for ExpertTensorLayout
impl RefUnwindSafe for ExpertTensorLayout
impl Send for ExpertTensorLayout
impl Sync for ExpertTensorLayout
impl Unpin for ExpertTensorLayout
impl UnsafeUnpin for ExpertTensorLayout
impl UnwindSafe for ExpertTensorLayout
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more