Skip to main content

BaseRenderCache

Type Alias BaseRenderCache 

Source
pub type BaseRenderCache = OnceLock<RenderedPrompt>;
Expand description

Memoized render of a MessageSequence’s base. Shared across the per-iteration MessageSequence instances that wrap the same base (typically the SessionGraphCache’s projected messages) so the chat projector’s render_prompt walk happens once per turn instead of once per LLM iteration.

Aliased Type§

pub struct BaseRenderCache { /* private fields */ }