Struct CacheSession 

pub struct CacheSession {
    pub matched_prefix_len: usize,
    pub block_indices: Vec<usize>,
}

A handle that tracks which cache blocks a specific request is using.

Holding a CacheSession keeps the referenced blocks’ ref_count elevated so they will not be evicted while the request is in flight.

Fields

matched_prefix_len: usize

Number of prefix tokens that were already cached.

block_indices: Vec<usize>

Indices of the cache blocks matched for this session (in order).

Implementations

impl CacheSession

pub fn new(matched_prefix_len: usize, block_indices: Vec<usize>) -> Self

Create a new session handle.

pub fn cached_tokens(&self, block_size: usize) -> usize

Number of tokens covered by cached blocks in this session.

May differ slightly from matched_prefix_len if the prefix was not an exact multiple of block_size, but in practice they will be equal.

pub fn is_empty(&self) -> bool

Returns true if no prefix tokens were cached.