Struct Tiered

Source

pub struct Tiered {
    pub host: HostExps,
    pub slots: MoeSlotCache,
}

Expand description

SPILLING-PLAN §3: the requested Tiered generalization. Structurally it is the existing HostExps (Tier 1/2 host backing, per-block) composed with the existing MoeSlotCache (Tier 0 GPU residency). Both seams are already present and unchanged; this names the composition. The MoE hot loop drives the two seams directly (expert_bytes() + with_moe_cache), so this is a documentation/structural alias, not a new hot path.

Fields§

§host: HostExps§slots: MoeSlotCache

Auto Trait Implementations§

§

Tiered

Struct Tiered Copy item path

Fields§

Auto Trait Implementations§

impl !RefUnwindSafe for Tiered

impl !Sync for Tiered

impl !UnwindSafe for Tiered

impl Freeze for Tiered

impl Send for Tiered

impl Unpin for Tiered

impl UnsafeUnpin for Tiered

Blanket Implementations§

impl<T> Any for Twhere T: 'static + ?Sized,

fn type_id(&self) -> TypeId

impl<T> Borrow<T> for Twhere T: ?Sized,

fn borrow(&self) -> &T

impl<T> BorrowMut<T> for Twhere T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

impl<T> From<T> for T

fn from(t: T) -> T

impl<T, U> Into<U> for Twhere U: From<T>,

fn into(self) -> U

impl<T, U> TryFrom<U> for Twhere U: Into<T>,

type Error = Infallible

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

impl<T, U> TryInto<U> for Twhere U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Struct Tiered

impl<T> Any for T
where T: 'static + ?Sized,

impl<T> Borrow<T> for T
where T: ?Sized,

impl<T> BorrowMut<T> for T
where T: ?Sized,

impl<T, U> Into<U> for T
where U: From<T>,

impl<T, U> TryFrom<U> for T
where U: Into<T>,

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,