Skip to main content

create_default_cache_manager

Function create_default_cache_manager 

Source
pub fn create_default_cache_manager(
    config: KVCacheConfig,
    database: Arc<MemoryDatabase>,
    llm_worker: Option<Arc<LLMWorker>>,
) -> Result<KVCacheManager>
Expand description

Create a default KV cache manager. Pass llm_worker to enable pre-clear summarization.