Enum CachedEntry 

pub enum CachedEntry {
    Generate(Box<GenerateResult>),
    Stream(Vec<StreamPart>),
}

A cached call result.

Mirrors the two model call shapes; Stream keeps the full part sequence so a hit can be replayed deterministically. Generate is boxed to keep the enum size balanced.

Variants

Generate(Box<GenerateResult>)

Cached LanguageModel::do_generate result.

Stream(Vec<StreamPart>)

Cached LanguageModel::do_stream part sequence.

Trait Implementations

impl Clone for CachedEntry

fn clone(&self) -> CachedEntry

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CachedEntry

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.