pub struct KernelPlanV0 {
pub decode_gemv: Int8Tier,
pub batch_gemm: Int8Tier,
}Expand description
The measured per-regime route assignment, decided once per process.
v0 of the KernelPlan: two regimes, no persistence (.fttspack owns that when it lands).
Safe to decide by noisy measurement because every tier produces bit-identical output — a
wrong pick costs microseconds, never correctness.
Fields§
§decode_gemv: Int8TierRoute for m=1 decode GEMVs (the talker/microdecoder step shape).
batch_gemm: Int8TierRoute for batched GEMMs (prefill, seq-16 verify, offline codec).
Trait Implementations§
Source§impl Clone for KernelPlanV0
impl Clone for KernelPlanV0
Source§fn clone(&self) -> KernelPlanV0
fn clone(&self) -> KernelPlanV0
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for KernelPlanV0
Source§impl Debug for KernelPlanV0
impl Debug for KernelPlanV0
impl Eq for KernelPlanV0
Source§impl PartialEq for KernelPlanV0
impl PartialEq for KernelPlanV0
impl StructuralPartialEq for KernelPlanV0
Auto Trait Implementations§
impl Freeze for KernelPlanV0
impl RefUnwindSafe for KernelPlanV0
impl Send for KernelPlanV0
impl Sync for KernelPlanV0
impl Unpin for KernelPlanV0
impl UnsafeUnpin for KernelPlanV0
impl UnwindSafe for KernelPlanV0
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more