pub enum ExpertBacking {
Resident(Vec<ExpertWeights>),
Stored {
store: Arc<ExpertStore<GgufExpertSource>>,
layouts: Vec<StoredExpertLayout>,
layer: u32,
},
}Expand description
How a layer’s routed experts are held. Resident is the original
always-in-memory form (owned f32 or zero-copy mmap views).
Stored holds only byte-range layouts; each use acquires the
expert’s bytes from a bounded, lease-protected
ferrox_core::expert_store::ExpertStore shared by every layer
(one global byte budget), builds temporary WeightMatrix views
over the leased buffer (WeightBytes::Shared, which pins the
cache entry for the views’ lifetime), and drops them after the
expert runs. Dequantized math over identical bytes is identical,
so the two backings are bit-equivalent by construction – pinned
by an integration test against the MoE fixture.
Variants§
Resident(Vec<ExpertWeights>)
Stored
Implementations§
Auto Trait Implementations§
impl Freeze for ExpertBacking
impl RefUnwindSafe for ExpertBacking
impl Send for ExpertBacking
impl Sync for ExpertBacking
impl Unpin for ExpertBacking
impl UnsafeUnpin for ExpertBacking
impl UnwindSafe for ExpertBacking
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more