Struct PromptCacheOptions 

pub struct PromptCacheOptions {
    pub mode: Option<PromptCacheMode>,
    pub ttl: Option<PromptCacheTtl>,
}

Options for prompt caching.

Fields

mode: Option<PromptCacheMode>

Controls whether OpenAI automatically creates an implicit cache breakpoint. Defaults to implicit.

ttl: Option<PromptCacheTtl>

The minimum lifetime applied to every implicit and explicit cache breakpoint written by the request. Defaults to 30m, currently the only supported value.

Trait Implementations

impl Clone for PromptCacheOptions

fn clone(&self) -> PromptCacheOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PromptCacheOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PromptCacheOptions

fn default() -> PromptCacheOptions

Returns the “default value” for a type.

impl Serialize for PromptCacheOptions

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.