Crate zeta_kv_cache

Crate zeta_kv_cache 

Source
Expand description

Unified KV Cache Implementation for Zeta Reticula

This module consolidates all KV cache functionality from:

  • kvquant_rs/src/block.rs (LogStructuredKVCache)
  • llm-rs/src/kv_cache.rs
  • llm-rs/src/kv_cache_manager.rs
  • zeta-vault-synergy implementations

Structs§

DataBlock
KVCacheConfig
KVCacheManagerAdapter
Compatibility wrapper for existing KVCacheManager implementations
KVCacheStats
UnifiedKVCache
Unified KV Cache that consolidates all previous implementations

Enums§

BlockState
EvictionPolicy
KVCacheError
PrecisionLevel

Traits§

KVCacheManager
Async trait for KV cache operations (for compatibility with existing code)

Functions§

create_kv_cache
Factory function to create KV cache instances