pub struct GgufExpertSource { /* private fields */ }Expand description
ExpertSource over a (possibly sharded) GGUF checkpoint: each
expert’s gate/up/down byte ranges are read positionally from the
owning shard file and concatenated, so a store miss touches exactly
that expert’s bytes – no mmap of the expert region, no shared seek
cursor.
Trait Implementations§
Source§impl ExpertSource for GgufExpertSource
impl ExpertSource for GgufExpertSource
Auto Trait Implementations§
impl Freeze for GgufExpertSource
impl RefUnwindSafe for GgufExpertSource
impl Send for GgufExpertSource
impl Sync for GgufExpertSource
impl Unpin for GgufExpertSource
impl UnsafeUnpin for GgufExpertSource
impl UnwindSafe for GgufExpertSource
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more