Struct TokenUsage 

pub struct TokenUsage {
    pub input: u64,
    pub cache_write_5m: u64,
    pub cache_write_1h: u64,
    pub cache_read: u64,
    pub output: u64,
}

Token counts, split the way the Anthropic and OpenAI usage objects split them.

Fields

input: u64

cache_write_5m: u64

cache_write_1h: u64

cache_read: u64

output: u64

Implementations

impl TokenUsage

pub fn cache_write(&self) -> u64

pub fn total(&self) -> u64

Everything the model consumed or produced. This is the “TOKENS” column.

pub fn prompt(&self) -> u64

The input side: everything sent to the model as the prompt, fresh input plus cache writes plus cache reads, but not the output it produced.

pub fn cache_hit_rate(&self) -> Option<f64>

The share of the prompt served from cache (the cheap reads), in 0..=1. A high number means most of the re-sent conversation was billed at the cache-read rate rather than full input; a low one on a long session is money left on the table. None when there was no prompt to judge, or the model does not cache at all.

pub fn add(&mut self, other: &TokenUsage)

pub fn sub(&mut self, other: &TokenUsage)

Trait Implementations

impl Clone for TokenUsage

fn clone(&self) -> TokenUsage

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenUsage

impl Debug for TokenUsage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TokenUsage

fn default() -> TokenUsage

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for TokenUsage

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for TokenUsage

fn eq(&self, other: &TokenUsage) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for TokenUsage

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for TokenUsage