pub struct PageStats {
pub pages_used: usize,
pub pages_free: usize,
pub num_pages: usize,
pub page_size: usize,
pub seq_len: usize,
pub layers_materialized: usize,
pub layers_total: usize,
pub layers_sliding: usize,
}Expand description
A paged cache’s page-table state at a point in time (for monitoring).
Fields§
§pages_used: usizePages holding live KV entries for this sequence.
pages_free: usizePages still available in this cache’s arena.
num_pages: usizeTotal pages in the arena (pages_used + pages_free when healthy).
page_size: usizeTokens per page.
seq_len: usizeCached sequence length in tokens.
layers_materialized: usizeLayers whose arena tensor is actually allocated. Arenas are lazy —
a layer materializes on its first write — so this rises through
the first prefill and stays below layers_total for models whose
sliding layers never touch the paged arena at all.
layers_total: usizeLayers in this cache.
layers_sliding: usizeLayers holding a rolling sliding-window store instead of pages.
Trait Implementations§
impl Copy for PageStats
impl Eq for PageStats
impl StructuralPartialEq for PageStats
Auto Trait Implementations§
impl Freeze for PageStats
impl RefUnwindSafe for PageStats
impl Send for PageStats
impl Sync for PageStats
impl Unpin for PageStats
impl UnsafeUnpin for PageStats
impl UnwindSafe for PageStats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<C> CloneExpand for Cwhere
C: Clone,
impl<C> CloneExpand for Cwhere
C: Clone,
fn __expand_clone_method(&self, _scope: &mut Scope) -> C
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.