pub struct CacheBreakpoints {
pub after_system: bool,
pub after_tools: bool,
pub after_skills: bool,
pub after_user_prompt: bool,
}Expand description
Marks the four section boundaries the runtime asks codecs to expose as cache breakpoints when the underlying provider supports them.
The order is fixed: system prompt, tool descriptions, skills, then the most recent user prompt. The “rest of the session” follows the last breakpoint and is therefore the only window eligible for in-band compaction by non-dedicated providers.
Fields§
§after_system: bool§after_tools: bool§after_skills: bool§after_user_prompt: boolImplementations§
Source§impl CacheBreakpoints
impl CacheBreakpoints
Sourcepub fn all() -> Self
pub fn all() -> Self
All four breakpoints active. The prompt assembler emits this layout for any session that has a non-empty system prompt and at least one user message; codecs may downgrade as needed.
Sourcepub fn count_active(&self) -> usize
pub fn count_active(&self) -> usize
Number of active breakpoints.
Trait Implementations§
Source§impl Clone for CacheBreakpoints
impl Clone for CacheBreakpoints
Source§fn clone(&self) -> CacheBreakpoints
fn clone(&self) -> CacheBreakpoints
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for CacheBreakpoints
Source§impl Debug for CacheBreakpoints
impl Debug for CacheBreakpoints
Source§impl Default for CacheBreakpoints
impl Default for CacheBreakpoints
Source§fn default() -> CacheBreakpoints
fn default() -> CacheBreakpoints
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for CacheBreakpoints
impl<'de> Deserialize<'de> for CacheBreakpoints
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for CacheBreakpoints
Source§impl JsonSchema for CacheBreakpoints
impl JsonSchema for CacheBreakpoints
Source§fn schema_name() -> String
fn schema_name() -> String
The name of the generated JSON Schema. Read more
Source§fn schema_id() -> Cow<'static, str>
fn schema_id() -> Cow<'static, str>
Returns a string that uniquely identifies the schema produced by this type. Read more
Source§fn json_schema(generator: &mut SchemaGenerator) -> Schema
fn json_schema(generator: &mut SchemaGenerator) -> Schema
Generates a JSON Schema for this type. Read more
Source§fn is_referenceable() -> bool
fn is_referenceable() -> bool
Whether JSON Schemas generated for this type should be re-used where possible using the
$ref keyword. Read moreSource§impl PartialEq for CacheBreakpoints
impl PartialEq for CacheBreakpoints
Source§fn eq(&self, other: &CacheBreakpoints) -> bool
fn eq(&self, other: &CacheBreakpoints) -> bool
Tests for
self and other values to be equal, and is used by ==.Source§impl Serialize for CacheBreakpoints
impl Serialize for CacheBreakpoints
impl StructuralPartialEq for CacheBreakpoints
Auto Trait Implementations§
impl Freeze for CacheBreakpoints
impl RefUnwindSafe for CacheBreakpoints
impl Send for CacheBreakpoints
impl Sync for CacheBreakpoints
impl Unpin for CacheBreakpoints
impl UnsafeUnpin for CacheBreakpoints
impl UnwindSafe for CacheBreakpoints
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.