pub struct TokenBudget {
pub max_tokens: usize,
}Expand description
Keep leading system message(s), then walk from the newest message
backward accumulating token counts, keeping messages until adding the
next would exceed max_tokens. Returns the kept messages in original
order. Mirrors upstream’s ContextWindow/token-budget strategy.
Fields§
§max_tokens: usizeImplementations§
Source§impl TokenBudget
impl TokenBudget
pub fn new(max_tokens: usize) -> TokenBudget
Trait Implementations§
Source§impl Clone for TokenBudget
impl Clone for TokenBudget
Source§fn clone(&self) -> TokenBudget
fn clone(&self) -> TokenBudget
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl CompactionStrategy for TokenBudget
impl CompactionStrategy for TokenBudget
impl Copy for TokenBudget
Auto Trait Implementations§
impl Freeze for TokenBudget
impl RefUnwindSafe for TokenBudget
impl Send for TokenBudget
impl Sync for TokenBudget
impl Unpin for TokenBudget
impl UnsafeUnpin for TokenBudget
impl UnwindSafe for TokenBudget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more