Struct PagedKvCache 

pub struct PagedKvCache { /* private fields */ }

One sequence’s view into a shared PagedKvStore: a block table (which physical blocks this sequence’s positions live in, in order) plus how many positions have been written so far. Unlike KvCache, this holds no K/V data itself – every read and write goes through the shared store.

Implementations

impl PagedKvCache

pub fn new() -> Self

pub fn seq_len(&self) -> usize

pub fn block_table(&self) -> &[usize]

pub fn push( &mut self, store: &mut PagedKvStore, k_step: &[f32], v_step: &[f32], ) -> Result<(), PagedStoreExhausted>

Appends one position’s key/value vectors, acquiring a new block from store first if the current tail block is full (or none held yet). Mirrors KvCache::push’s signature/semantics exactly, just against shared storage instead of a private buffer.

pub fn release(&mut self, store: &mut PagedKvStore)

Releases every block this sequence holds back to store. Must be called explicitly (there’s no Drop here, since dropping needs a &mut PagedKvStore this type doesn’t own a reference to) – mirrors KvCache::release_to_pool, just not automatic.

Trait Implementations

impl Clone for PagedKvCache

fn clone(&self) -> PagedKvCache

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PagedKvCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PagedKvCache

fn default() -> PagedKvCache

Returns the “default value” for a type.