Struct CacheWarmingDecision 

pub struct CacheWarmingDecision {
    pub phase: CacheWarmingPhase,
    pub warm_cost: f64,
    pub miss_cost: f64,
    pub continuation_probability: f64,
    pub expected_savings: f64,
    pub economics_available: bool,
    pub warm: bool,
}

Inputs and outcome of one warm-or-stop decision, as /session shows them.

Fields

phase: CacheWarmingPhase

When the decision is made.

warm_cost: f64

Price of the refresh: a cache read of the prompt and one output token.

miss_cost: f64

Extra price of the next real request if the cache entry is lost.

continuation_probability: f64

Estimated chance that a real request arrives before the entry expires.

expected_savings: f64

continuation_probability * miss_cost - warm_cost.

economics_available: bool

False when the prompt size or the model’s prices are unknown.

warm: bool

pi’s decision: warm when the expected savings are at least $0.05.

Trait Implementations

impl Clone for CacheWarmingDecision

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CacheWarmingDecision

impl Debug for CacheWarmingDecision

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for CacheWarmingDecision

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CacheWarmingDecision