Enum PromptCacheRetention 

pub enum PromptCacheRetention {
    InMemory,
    TwentyFourHours,
}

Available on crate features models and openai only.

Prompt cache retention duration.

Controls how long prompt prefixes are cached for repeated requests. Caching reduces costs for requests that share the same prompt prefix.

Variants

InMemory

In-memory cache (shortest retention, lowest cost).

TwentyFourHours

24-hour cache retention.

Trait Implementations

impl Clone for PromptCacheRetention

fn clone(&self) -> PromptCacheRetention

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for PromptCacheRetention

impl Debug for PromptCacheRetention

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for PromptCacheRetention

fn deserialize<__D>( __deserializer: __D, ) -> Result<PromptCacheRetention, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for PromptCacheRetention

impl PartialEq for PromptCacheRetention

fn eq(&self, other: &PromptCacheRetention) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for PromptCacheRetention

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for PromptCacheRetention