pub struct DefaultTokenCounter;Expand description
Default token counter using the chars / 4 heuristic.
LlmMessage variants: sums character lengths of all text-bearing content
blocks and divides by 4. CustomMessage variants count as 100 tokens flat.
Trait Implementations§
Source§impl Clone for DefaultTokenCounter
impl Clone for DefaultTokenCounter
Source§fn clone(&self) -> DefaultTokenCounter
fn clone(&self) -> DefaultTokenCounter
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for DefaultTokenCounter
impl Debug for DefaultTokenCounter
Source§impl Default for DefaultTokenCounter
impl Default for DefaultTokenCounter
Source§fn default() -> DefaultTokenCounter
fn default() -> DefaultTokenCounter
Returns the “default value” for a type. Read more
Source§impl TokenCounter for DefaultTokenCounter
impl TokenCounter for DefaultTokenCounter
Source§fn count_tokens(&self, message: &AgentMessage) -> usize
fn count_tokens(&self, message: &AgentMessage) -> usize
Return the estimated token count for a single message.
impl Copy for DefaultTokenCounter
Auto Trait Implementations§
impl Freeze for DefaultTokenCounter
impl RefUnwindSafe for DefaultTokenCounter
impl Send for DefaultTokenCounter
impl Sync for DefaultTokenCounter
impl Unpin for DefaultTokenCounter
impl UnsafeUnpin for DefaultTokenCounter
impl UnwindSafe for DefaultTokenCounter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more