Enum CacheCount 

pub enum CacheCount {
    Reported(Tokens),
    Unreported,
}

One cache count as a provider reported it: a number, or nothing at all.

A provider that never reports its cache and one that reports a zero hit are different facts to the User, so the two do not share a value (crates/kernel/spec/Model.lean D36). A stored row spells Unreported by leaving the key out; an absent key or null reads back as Unreported, a present 0 as Reported(0).

Variants

Reported(Tokens)

Unreported

Implementations

impl CacheCount

pub const fn reported(self) -> Option<Tokens>

The count when the provider gave one.

pub const fn or_zero(self) -> Tokens

The count for arithmetic that subtracts the cached part from the whole prompt (pricing, the context gauge): an unreported count is read as nothing cached, the reading those sums had before the distinction existed.

Trait Implementations

impl Clone for CacheCount

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CacheCount

impl Debug for CacheCount

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CacheCount

fn default() -> Self

Returns the “default value” for a type.

impl Eq for CacheCount

impl From<Option<Tokens>> for CacheCount

fn from(count: Option<Tokens>) -> CacheCount

Converts to this type from the input type.

impl PartialEq for CacheCount

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CacheCount