Struct AutoCache 

pub struct AutoCache {
    pub ttl: Duration,
    pub implicit_floor: u64,
    pub implicit_ceiling: u64,
    pub min_tokens: u64,
    pub min_gain: u64,
    pub cached_ratio: f64,
    pub storage_ratio_per_hour: f64,
}

The Auto policy’s parameters. The price ratios default to gemini-3.8-flash standard prices relative to its input price (cached read $0.075 and storage $0.50 per 1M tokens per hour, against $0.75 input); AutoCache::for_model reads the cached-read ratio of another model from the built-in catalog. The catalog holds no storage price.

Fields

ttl: Duration

The shortest TTL a new cache gets.

implicit_floor: u64

Smallest request implicit caching serves (4,096 tokens on Gemini 3).

implicit_ceiling: u64

Above this many cacheable tokens the book sends requests inline and lets implicit caching serve them, until implicit caching is seen failing.

min_tokens: u64

Gemini’s minimum cache size.

min_gain: u64

The fewest tokens a new cache must add over the one it replaces.

cached_ratio: f64

Cached-read price over input price.

storage_ratio_per_hour: f64

Storage price per hour over input price.

Implementations

impl AutoCache

pub fn for_model(model: &str) -> Self

The default policy with the cached-read ratio of the Gemini API’s model from the built-in catalog’s pricing. A model the catalog does not price keeps the default ratio.

Trait Implementations

impl Clone for AutoCache

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for AutoCache

impl Debug for AutoCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AutoCache

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for AutoCache

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for AutoCache