Enum PromptCacheStrategy 

pub enum PromptCacheStrategy {
    Automatic,
    Explicit {
        breakpoints: Vec<PromptCacheBreakpoint>,
    },
}

Provider-neutral prompt caching strategy.

Variants

Automatic

Let the provider decide the cacheable prefix automatically.

Explicit

Apply explicit cache breakpoints to selected prefix boundaries.

Fields

breakpoints: Vec<PromptCacheBreakpoint>

Cache breakpoints in transcript/tool order.

Implementations

impl PromptCacheStrategy

pub fn automatic() -> Self

Uses the provider’s native automatic cache behavior when available, or any adapter-provided automatic planning fallback.

pub fn explicit( breakpoints: impl IntoIterator<Item = PromptCacheBreakpoint>, ) -> Self

Uses explicit cache breakpoints.

Trait Implementations

impl Clone for PromptCacheStrategy

fn clone(&self) -> PromptCacheStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PromptCacheStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PromptCacheStrategy

fn default() -> PromptCacheStrategy

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for PromptCacheStrategy

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for PromptCacheStrategy

fn eq(&self, other: &PromptCacheStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for PromptCacheStrategy

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Eq for PromptCacheStrategy

impl StructuralPartialEq for PromptCacheStrategy