pub struct PageGroup(pub u32);Expand description
A handle to one block in every layer.
The unit of sharing between sequences, and the only thing small
enough to be what a radix prefix cache stores: that cache maps a
token prefix to ONE index per token, while a position’s KV lives in
n_layers different blocks. A group is the name for all of them.
Tuple Fields§
§0: u32Trait Implementations§
impl Copy for PageGroup
impl Eq for PageGroup
Source§impl Ord for PageGroup
impl Ord for PageGroup
1.21.0 (const: unstable) · Source§fn max(self, other: Self) -> Selfwhere
Self: Sized,
fn max(self, other: Self) -> Selfwhere
Self: Sized,
Compares and returns the maximum of two values. Read more
Source§impl PartialOrd for PageGroup
impl PartialOrd for PageGroup
impl StructuralPartialEq for PageGroup
Auto Trait Implementations§
impl Freeze for PageGroup
impl RefUnwindSafe for PageGroup
impl Send for PageGroup
impl Sync for PageGroup
impl Unpin for PageGroup
impl UnsafeUnpin for PageGroup
impl UnwindSafe for PageGroup
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more