Skip to main content

Module cache_extractor

offline_intelligence::cache_management

Module cache_extractor 

Source
Expand description

Extracts and preserves important KV cache entries

Structs§

CacheExtractor
Extracts important KV cache entries
CacheExtractorConfig
ExtractedCacheEntry
An extracted KV cache entry with its metadata
KVEntry
Represents a KV cache entry (simplified for extraction)

Enums§

CacheEntryType
Types of KV cache entries that can be preserved

Traits§

CacheEntryScorer