Skip to main content

Module allocator

Module allocator 

Source

Structs§

BlockAllocator
Central allocator managing the physical pool of KV-cache blocks.

Functions§

compute_block_prefix_hash
Computes an incremental hash over a slice of tokens given an optional parent block hash.