pub struct KdaState { /* private fields */ }Expand description
Per-layer decode-time state: the short causal convs’ recent-input
history (up to short_conv_kernel_size - 1 raw projected vectors
each) and the recurrent state S ([n_heads, head_dim, head_dim],
flattened, zero-initialized) – fundamentally different from
ferrox_core::cache::KvCache’s growing K/V history, since KDA’s
per-layer state is fixed-size regardless of sequence length.
Implementations§
Auto Trait Implementations§
impl Freeze for KdaState
impl RefUnwindSafe for KdaState
impl Send for KdaState
impl Sync for KdaState
impl Unpin for KdaState
impl UnsafeUnpin for KdaState
impl UnwindSafe for KdaState
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more