Struct Block 

pub struct Block {
    pub block_id: BlockId,
    pub ref_count: u32,
    pub is_free: bool,
    pub content_hash: Option<u64>,
}

Represents a single KV cache block

Fields

block_id: BlockId

Unique block ID

ref_count: u32

Reference count (number of requests using this block)

is_free: bool

Whether this block is free

content_hash: Option<u64>

For prefix caching: hash of the token sequence in this block

Implementations

impl Block

pub fn new(block_id: BlockId) -> Self

Create a new free block

pub fn allocate(&mut self, content_hash: Option<u64>) -> Option<u64>

Allocate this block (increment ref count, mark as not free)

pub fn release(&mut self)

Release this block (decrement ref count, mark as free if ref count reaches 0)

Trait Implementations

impl Clone for Block

fn clone(&self) -> Block

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Block

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.