pub struct TokenBufferConfig {
pub max_tokens: usize,
pub buffer_tokens: usize,
pub overflow_strategy: TokenOverflowStrategy,
}Expand description
Configuration for token-aware memory buffer
Fields§
§max_tokens: usizeMaximum tokens to keep in memory
buffer_tokens: usizeBuffer size to keep below max (for safety)
overflow_strategy: TokenOverflowStrategyHow to handle token overflow
Trait Implementations§
Source§impl Clone for TokenBufferConfig
impl Clone for TokenBufferConfig
Source§fn clone(&self) -> TokenBufferConfig
fn clone(&self) -> TokenBufferConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TokenBufferConfig
impl Debug for TokenBufferConfig
Auto Trait Implementations§
impl Freeze for TokenBufferConfig
impl RefUnwindSafe for TokenBufferConfig
impl Send for TokenBufferConfig
impl Sync for TokenBufferConfig
impl Unpin for TokenBufferConfig
impl UnwindSafe for TokenBufferConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more