Struct KvManagerConfig 

pub struct KvManagerConfig {
    pub block_size: usize,
    pub max_blocks_gpu: usize,
    pub max_blocks_cpu: usize,
    pub enable_prefix_cache: bool,
    pub enable_metrics: bool,
}

Internal KV Cache manager configuration

Note: This is distinct from ferrum_types::KvCacheConfig which is the engine-level configuration. This type is used internally by the KV cache manager implementation.

Fields

block_size: usize

max_blocks_gpu: usize

max_blocks_cpu: usize

enable_prefix_cache: bool

enable_metrics: bool

Trait Implementations

impl Clone for KvManagerConfig

fn clone(&self) -> KvManagerConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KvManagerConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.