pub struct TrackerTokenUsage {
pub prompt_tokens: usize,
pub completion_tokens: usize,
pub total_tokens: usize,
}Expand description
Token usage statistics (internal type for the counter module)
Note: language_models::TokenUsage is the usage returned by the LLM API (fields are usize);
this TrackerTokenUsage is locally tracked cumulative usage, also usize fields, so the two
convert without precision loss (Q6: unified base type, no more usize vs u32 naming clash).
No TokenUsage alias is used here, to avoid confusion with language_models::TokenUsage.
Fields§
§prompt_tokens: usizeCumulative prompt token count
completion_tokens: usizeCumulative completion token count
total_tokens: usizeCumulative total token count (prompt + completion)
Implementations§
Trait Implementations§
Source§impl Clone for TrackerTokenUsage
impl Clone for TrackerTokenUsage
Source§fn clone(&self) -> TrackerTokenUsage
fn clone(&self) -> TrackerTokenUsage
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TrackerTokenUsage
impl Debug for TrackerTokenUsage
Source§impl Default for TrackerTokenUsage
impl Default for TrackerTokenUsage
Source§fn default() -> TrackerTokenUsage
fn default() -> TrackerTokenUsage
Returns the “default value” for a type. Read more
Source§impl PartialEq for TrackerTokenUsage
impl PartialEq for TrackerTokenUsage
impl StructuralPartialEq for TrackerTokenUsage
Auto Trait Implementations§
impl Freeze for TrackerTokenUsage
impl RefUnwindSafe for TrackerTokenUsage
impl Send for TrackerTokenUsage
impl Sync for TrackerTokenUsage
impl Unpin for TrackerTokenUsage
impl UnsafeUnpin for TrackerTokenUsage
impl UnwindSafe for TrackerTokenUsage
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more