pub struct TokenBasedSummarizer {
pub threshold: usize,
pub retain_last: usize,
pub max_summary_chars: usize,
}Expand description
Default token-based summarizer:
- Estimates tokens roughly as total characters / 4
- Triggers when estimated tokens exceed
threshold(default 100_000) - Keeps
retain_lastmost recent messages and summarizes the older ones into a single system message. - The summary is a concatenation/truncation of older messages, not an LLM semantic summary.
Fields§
§threshold: usize§retain_last: usize§max_summary_chars: usizeTrait Implementations§
Source§impl Clone for TokenBasedSummarizer
impl Clone for TokenBasedSummarizer
Source§fn clone(&self) -> TokenBasedSummarizer
fn clone(&self) -> TokenBasedSummarizer
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TokenBasedSummarizer
impl Debug for TokenBasedSummarizer
Source§impl Default for TokenBasedSummarizer
impl Default for TokenBasedSummarizer
Source§impl Summarizer for TokenBasedSummarizer
impl Summarizer for TokenBasedSummarizer
Source§fn should_summarize(&self, history: &[Message]) -> bool
fn should_summarize(&self, history: &[Message]) -> bool
Return true if history should be summarized now.
Auto Trait Implementations§
impl Freeze for TokenBasedSummarizer
impl RefUnwindSafe for TokenBasedSummarizer
impl Send for TokenBasedSummarizer
impl Sync for TokenBasedSummarizer
impl Unpin for TokenBasedSummarizer
impl UnsafeUnpin for TokenBasedSummarizer
impl UnwindSafe for TokenBasedSummarizer
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more