pub enum CompressionStrategy {
TruncateOldest,
Summarize {
model: String,
},
}Expand description
What to do when the context window fills up.
Variants§
TruncateOldest
Drop oldest non-system messages until the budget is met.
Summarize
Ask Ollama itself to summarise the oldest half of the history into one compact system message, then discard the originals.
Trait Implementations§
Source§impl Clone for CompressionStrategy
impl Clone for CompressionStrategy
Source§fn clone(&self) -> CompressionStrategy
fn clone(&self) -> CompressionStrategy
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for CompressionStrategy
impl Debug for CompressionStrategy
Auto Trait Implementations§
impl Freeze for CompressionStrategy
impl RefUnwindSafe for CompressionStrategy
impl Send for CompressionStrategy
impl Sync for CompressionStrategy
impl Unpin for CompressionStrategy
impl UnsafeUnpin for CompressionStrategy
impl UnwindSafe for CompressionStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more