Skip to main content

PROMPT_CACHE

Static PROMPT_CACHE 

Source
pub static PROMPT_CACHE: LazyLock<SystemPromptCache<(String, SystemPromptReport)>>
Expand description

Global prompt cache shared across runs. Caches the composed prompt string together with its SystemPromptReport so cache hits surface the same token-budget report a cache miss would have computed.

Sharded into 16 RwLock<LruCache> shards to eliminate mutex contention in multi-project workflows.