Struct CacheOptions 

pub struct CacheOptions {
    pub cache_system_prompt: bool,
    pub cache_tools: bool,
    pub cache_recent_turns: usize,
    pub extended_ttl: bool,
    pub global_scope: bool,
}

Controls which parts of the request are eligible for prompt caching.

Fields

cache_system_prompt: bool

Cache the system prompt across requests.

cache_tools: bool

Cache tool definitions.

cache_recent_turns: usize

Number of recent conversation turns to cache.

extended_ttl: bool

Use 1-hour TTL instead of default 5-minute.

global_scope: bool

Use global scope (shared across users with identical prompts).

Trait Implementations

impl Clone for CacheOptions

fn clone(&self) -> CacheOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CacheOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CacheOptions

fn default() -> CacheOptions

Returns the “default value” for a type.