pub struct ConservativeCounter;Expand description
Conservative overestimate for runtime budgets.
Non-Latin letters and punctuation cost one token each. ASCII words cost one token per three characters. This is not a vendor tokenizer; it is meant to refuse a packet before a model does.
Trait Implementations§
Source§impl Clone for ConservativeCounter
impl Clone for ConservativeCounter
impl Copy for ConservativeCounter
Source§impl Debug for ConservativeCounter
impl Debug for ConservativeCounter
Source§impl Default for ConservativeCounter
impl Default for ConservativeCounter
impl Eq for ConservativeCounter
Source§impl PartialEq for ConservativeCounter
impl PartialEq for ConservativeCounter
impl StructuralPartialEq for ConservativeCounter
Source§impl TokenCounter for ConservativeCounter
impl TokenCounter for ConservativeCounter
Auto Trait Implementations§
impl Freeze for ConservativeCounter
impl RefUnwindSafe for ConservativeCounter
impl Send for ConservativeCounter
impl Sync for ConservativeCounter
impl Unpin for ConservativeCounter
impl UnsafeUnpin for ConservativeCounter
impl UnwindSafe for ConservativeCounter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more