pub enum SinkMode {
Key0,
Column,
Off,
}Expand description
How the per-head sinks enter the windowed blocks.
Variants§
Key0
HF / vLLM: logit[h, i, key 0] += sinks[h] (the default).
Column
sglang FA3: an extra softmax column carrying no value.
Off
No sinks (A/B only).
Implementations§
Trait Implementations§
impl Copy for SinkMode
impl Eq for SinkMode
impl StructuralPartialEq for SinkMode
Auto Trait Implementations§
impl Freeze for SinkMode
impl RefUnwindSafe for SinkMode
impl Send for SinkMode
impl Sync for SinkMode
impl Unpin for SinkMode
impl UnsafeUnpin for SinkMode
impl UnwindSafe for SinkMode
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.