Struct CacheMarker 

pub struct CacheMarker {
    pub offset: usize,
    pub length: usize,
    pub cache_type: CacheType,
}

A cache marker indicating a byte range suitable for provider caching.

Each marker specifies the offset and length of a cacheable section within the assembled prompt, along with the cache type.

Fields

offset: usize

Starting byte offset of the cacheable section.

length: usize

Length of the cacheable section in bytes.

cache_type: CacheType

Type of caching to apply to this section.

Trait Implementations

impl Clone for CacheMarker

fn clone(&self) -> CacheMarker

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CacheMarker

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<CacheMarker> for SystemCacheMarker

fn from(marker: CacheMarker) -> Self

Converts to this type from the input type.

impl PartialEq for CacheMarker

fn eq(&self, other: &CacheMarker) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CacheMarker