Struct TokenCounts 

pub struct TokenCounts {
    pub input: u64,
    pub output: u64,
}

Token counts for a single request/operation

Fields

input: u64

Number of tokens in the input/prompt

output: u64

Number of tokens in the output/completion

Implementations

impl TokenCounts

pub fn new(input: u64, output: u64) -> Self

Create new token counts

pub fn total(&self) -> u64

Total tokens (input + output)

pub fn add(&mut self, other: &TokenCounts)

Add another TokenCounts to this one

Trait Implementations

impl Clone for TokenCounts

fn clone(&self) -> TokenCounts

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenCounts

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TokenCounts

fn default() -> TokenCounts

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for TokenCounts

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for TokenCounts

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for TokenCounts

fn eq(&self, other: &TokenCounts) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for TokenCounts

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for TokenCounts

impl Eq for TokenCounts

impl StructuralPartialEq for TokenCounts