Struct KvBlockPool 

pub struct KvBlockPool { /* private fields */ }

A bounded pool of fixed-size KV-cache blocks (in positions) shared across many KvCache instances, typically one pool per server process. Each KvCache::with_pool acquires one block up front and one more each time it grows past its currently held capacity; free_blocks is therefore a live, accurate admission-control signal – a caller can check it before accepting a new request rather than discovering exhaustion only after committing memory.

Implementations

impl KvBlockPool

pub fn new(block_size: usize, total_blocks: usize) -> Self

block_size positions per block, total_blocks blocks in the whole shared budget (so block_size * total_blocks positions total, across however many caches draw from this pool at once).

pub fn block_size(&self) -> usize

pub fn total_blocks(&self) -> usize

pub fn free_blocks(&self) -> usize