Struct Tokens 

pub struct Tokens {
    pub input: u64,
    pub output: u64,
    pub source: TokenSource,
}

The tokens one call spent, and where the count came from.

Fields

input: u64

output: u64

source: TokenSource

Implementations

impl Tokens

pub fn estimate( profile: &ClassifierProfile, state: &str, questions: &BTreeMap<String, Question>, answers: Option<&BTreeMap<String, Answer>>, ) -> Self

Estimates one call at ceil(chars / 4) per side.

Input is the state as the adapter sends it — truncated by profile the way the adapter truncates it, so an over-long state is not billed for text that never left — plus every question’s id, instructions and criteria or levels (names and meanings). Output is the answers rendered as id, value and every probability label with its number to two places; None (a failed call) is zero output.

An estimate, tagged TokenSource::Estimated: each adapter wraps the text in its own prompt and tokenizes it its own way. It compares adapters asked the same questions fairly, and it is not what the vendor will invoice.

Trait Implementations

impl Clone for Tokens

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Tokens

impl Debug for Tokens

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for Tokens

impl Hash for Tokens

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Tokens

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Tokens