pub enum SwaWindowOverride {
Honour,
Drop,
Pin(usize),
}Expand description
What llama.cpp does with a nonzero attention.sliding_window the
file declares, for the architectures whose load_arch_hparams does
not simply honour it.
Three answers, one table: HONOUR (every architecture not named),
DROP (the two swa_disabled_by_arch rows – no layer slides), and
PIN (the window is replaced by a literal, and the layers still
slide). swa_disabled_by_arch is DERIVED from this so the two
cannot disagree about which rows decline the file’s value.
Variants§
Honour
The file’s value is the window.
Drop
No window at all, whatever the file says.
Pin(usize)
This window, whatever the file says.
Trait Implementations§
Source§impl Clone for SwaWindowOverride
impl Clone for SwaWindowOverride
impl Copy for SwaWindowOverride
Source§impl Debug for SwaWindowOverride
impl Debug for SwaWindowOverride
impl Eq for SwaWindowOverride
Source§impl PartialEq for SwaWindowOverride
impl PartialEq for SwaWindowOverride
impl StructuralPartialEq for SwaWindowOverride
Auto Trait Implementations§
impl Freeze for SwaWindowOverride
impl RefUnwindSafe for SwaWindowOverride
impl Send for SwaWindowOverride
impl Sync for SwaWindowOverride
impl Unpin for SwaWindowOverride
impl UnsafeUnpin for SwaWindowOverride
impl UnwindSafe for SwaWindowOverride
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more