Struct PagePool 

pub struct PagePool { /* private fields */ }

Manages free / allocated pages for the simulated SGLang KV cache.

SGLang’s paged allocator owns and frees whole pages even though its public interface returns flattened token indices. This pool preserves that ownership model and only expands page IDs while a request is active.

Implementations

impl PagePool

pub fn new(total_tokens: usize, page_size: usize) -> Self

pub fn allocate_pages(&mut self, count: usize) -> Option<Vec<KvPageId>>

pub fn allocate_indices_into( &mut self, new_tokens: usize, indices: &mut Vec<usize>, ) -> bool

Append flattened indices for new_tokens, allocating whole pages only when the request’s current final page has no remaining slots.

pub fn expand_pages(&self, pages: &[KvPageId], token_count: usize) -> Vec<usize>

pub fn free_pages(&mut self, pages: &[KvPageId])

pub fn free_indices(&mut self, indices: &[usize]) -> Vec<KvPageId>

Free every distinct page represented by a contiguous request-index list.

pub fn available_pages(&self) -> usize

pub fn available(&self) -> usize

pub fn total(&self) -> usize