pub enum HeadMap {
Tiled,
Grouped,
}Expand description
How V head h finds its K head.
Variants§
Tiled
h % n_k_heads (Qwen3.5: llama-model.cpp:526, “k0_v0, k1_v1,
k0_v2, k1_v3”).
Grouped
h / (n_v_heads / n_k_heads) (Qwen3-Next: :525, “k0_v0, k0_v1,
k1_v2, k1_v3”).
Implementations§
Trait Implementations§
impl Copy for HeadMap
impl Eq for HeadMap
impl StructuralPartialEq for HeadMap
Auto Trait Implementations§
impl Freeze for HeadMap
impl RefUnwindSafe for HeadMap
impl Send for HeadMap
impl Sync for HeadMap
impl Unpin for HeadMap
impl UnsafeUnpin for HeadMap
impl UnwindSafe for HeadMap
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more