pub enum BatchWindow {
Uniform(Option<usize>),
PerQuery,
}Expand description
ModelConfig::batch_window’s answer.
Variants§
Uniform(Option<usize>)
Every query in the batch takes this window (None: full causal).
PerQuery
Each query takes ModelConfig::layer_window_for_query at its
own position.
Trait Implementations§
Source§impl Clone for BatchWindow
impl Clone for BatchWindow
impl Copy for BatchWindow
Source§impl Debug for BatchWindow
impl Debug for BatchWindow
impl Eq for BatchWindow
Source§impl PartialEq for BatchWindow
impl PartialEq for BatchWindow
impl StructuralPartialEq for BatchWindow
Auto Trait Implementations§
impl Freeze for BatchWindow
impl RefUnwindSafe for BatchWindow
impl Send for BatchWindow
impl Sync for BatchWindow
impl Unpin for BatchWindow
impl UnsafeUnpin for BatchWindow
impl UnwindSafe for BatchWindow
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more