Struct PrefixPool 

pub struct PrefixPool { /* private fields */ }

Synthetic prefixes shared by sessions of one harness, model, and working directory.

Usage reports how much of a session’s first request was already cached, but not which earlier request wrote it. The pool attributes that prefix to context such sessions share, such as the system prompt and tool definitions, so replay can reuse it across sessions.

Implementations

impl PrefixPool

pub fn prefix( &mut self, key: &str, length: usize, block_size: usize, ) -> Result<&ReplayBase>

Returns the shared stream for key, extended to at least length tokens.

Trait Implementations

impl Debug for PrefixPool

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PrefixPool

fn default() -> Self

Returns the “default value” for a type.