pub struct TokenBudget {
pub max_tokens: usize,
}Expand description
The newest messages within max_tokens, as HeuristicTokenCounter
counts them: walking back from the newest, it stops before the first
message that does not fit.
Fields§
§max_tokens: usizeThe budget.
Implementations§
Trait Implementations§
Auto Trait Implementations§
impl Forget for TokenBudget
impl Freeze for TokenBudget
impl Move for TokenBudget
impl RefUnwindSafe for TokenBudget
impl Send for TokenBudget
impl Sync for TokenBudget
impl Unpin for TokenBudget
impl UnsafeUnpin for TokenBudget
impl UnwindSafe for TokenBudget
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more