pub struct CompactionSettings {
pub enabled: bool,
pub reserve_tokens: u64,
pub keep_recent_tokens: u64,
}Expand description
When compaction runs and how much it keeps: [compaction] in settings.
Fields§
§enabled: boolWhether a conversation is compacted on its own: near the window, and after a request
refused as too long or a reply the window cut short. /compact works either way.
reserve_tokens: u64Tokens of the model’s input limit kept free for the reply.
keep_recent_tokens: u64About how many tokens of the newest messages stay as they are.
Implementations§
Source§impl CompactionSettings
impl CompactionSettings
Sourcepub fn should_compact(&self, context_tokens: u64, context_window: u64) -> bool
pub fn should_compact(&self, context_tokens: u64, context_window: u64) -> bool
Whether a context of context_tokens in a window of context_window tokens is compacted
on its own: when enabled and it leaves less than the reserve free.
Trait Implementations§
Source§impl Clone for CompactionSettings
impl Clone for CompactionSettings
impl Copy for CompactionSettings
Source§impl Debug for CompactionSettings
impl Debug for CompactionSettings
Source§impl Default for CompactionSettings
impl Default for CompactionSettings
Source§impl<'de> Deserialize<'de> for CompactionSettingswhere
CompactionSettings: Default,
impl<'de> Deserialize<'de> for CompactionSettingswhere
CompactionSettings: Default,
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for CompactionSettings
Source§impl PartialEq for CompactionSettings
impl PartialEq for CompactionSettings
Source§impl Serialize for CompactionSettings
impl Serialize for CompactionSettings
impl StructuralPartialEq for CompactionSettings
Auto Trait Implementations§
impl Forget for CompactionSettings
impl Freeze for CompactionSettings
impl Move for CompactionSettings
impl RefUnwindSafe for CompactionSettings
impl Send for CompactionSettings
impl Sync for CompactionSettings
impl Unpin for CompactionSettings
impl UnsafeUnpin for CompactionSettings
impl UnwindSafe for CompactionSettings
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
Source§fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
Convert this value without routing structured data through a string.