pub struct TokenBudget {
pub max_tokens: usize,
pub preserve_first_user: bool,
}Expand description
Keep leading system message(s), then walk from the newest message
backward accumulating token counts, keeping messages until adding the
next would exceed max_tokens. Returns the kept messages in original
order. Mirrors upstream’s ContextWindow/token-budget strategy.
Fields§
§max_tokens: usize§preserve_first_user: boolImplementations§
Source§impl TokenBudget
impl TokenBudget
pub fn new(max_tokens: usize) -> TokenBudget
Sourcepub fn preserve_first_user(self) -> TokenBudget
pub fn preserve_first_user(self) -> TokenBudget
Also retain the earliest user message, whatever the token budget — see
Truncation::preserve_first_user, which this mirrors. As there, the
preserved message is added regardless of budget, so the retained set
may exceed max_tokens.
Trait Implementations§
Source§impl Clone for TokenBudget
impl Clone for TokenBudget
Source§fn clone(&self) -> TokenBudget
fn clone(&self) -> TokenBudget
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl CompactionStrategy for TokenBudget
impl CompactionStrategy for TokenBudget
impl Copy for TokenBudget
Auto Trait Implementations§
impl Freeze for TokenBudget
impl RefUnwindSafe for TokenBudget
impl Send for TokenBudget
impl Sync for TokenBudget
impl Unpin for TokenBudget
impl UnsafeUnpin for TokenBudget
impl UnwindSafe for TokenBudget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more