pub struct CompactionSettings {
pub enabled: bool,
pub reserve_tokens: u32,
pub keep_recent_tokens: u32,
pub use_summarization: bool,
}Expand description
Compaction settings for managing context window
Fields§
§enabled: boolEnable token-aware compaction (default: true)
reserve_tokens: u32Tokens to reserve for LLM response (default: 16384)
keep_recent_tokens: u32Recent tokens to keep when compacting (default: 20000)
use_summarization: boolUse LLM summarization instead of truncation (default: true)
Trait Implementations§
Source§impl Clone for CompactionSettings
impl Clone for CompactionSettings
Source§fn clone(&self) -> CompactionSettings
fn clone(&self) -> CompactionSettings
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CompactionSettings
impl Debug for CompactionSettings
Source§impl Default for CompactionSettings
impl Default for CompactionSettings
Source§impl<'de> Deserialize<'de> for CompactionSettings
impl<'de> Deserialize<'de> for CompactionSettings
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for CompactionSettings
impl PartialEq for CompactionSettings
impl StructuralPartialEq for CompactionSettings
Auto Trait Implementations§
impl Freeze for CompactionSettings
impl RefUnwindSafe for CompactionSettings
impl Send for CompactionSettings
impl Sync for CompactionSettings
impl Unpin for CompactionSettings
impl UnsafeUnpin for CompactionSettings
impl UnwindSafe for CompactionSettings
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more