Skip to main content

Module cache_scorer

offline_intelligence::cache_management

Module cache_scorer 

Source
Expand description

Scores the importance of KV cache entries for retention and retrieval

Structs§

CacheEntryParams
Parameters for scoring a cache entry
CacheEntryScorer
Scores importance of KV cache entries
CacheScoringConfig

Functions§

score_message_importance
Score the importance of a conversation message based on its role and content.