Struct InferenceUsageRecord 

pub struct InferenceUsageRecord {
    pub kind: InferenceKind,
    pub stage: String,
    pub iteration: usize,
    pub provider: String,
    pub model: String,
    pub prompt_tokens: usize,
    pub completion_tokens: usize,
    pub cached_tokens: usize,
    pub cache_write_tokens: usize,
    pub at: i64,
}

One provider call’s cost, as folded out of the journal.

The flattened form of RunRecord::InferenceUsage, so a consumer walking a folded run does not have to match the record enum to read a number.

Fields

kind: InferenceKind

Which kind of call this was.

stage: String

The stage the run was in, empty for the title call.

iteration: usize

The stage-local iteration index.

provider: String

The provider that served the call.

model: String

The model the call targeted.

prompt_tokens: usize

Prompt tokens billed.

completion_tokens: usize

Completion tokens billed.

cached_tokens: usize

Tokens read from provider cache.

cache_write_tokens: usize

Tokens written to provider cache.

at: i64

Unix seconds.

Trait Implementations

impl Clone for InferenceUsageRecord

fn clone(&self) -> InferenceUsageRecord

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceUsageRecord

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for InferenceUsageRecord

impl PartialEq for InferenceUsageRecord

fn eq(&self, other: &InferenceUsageRecord) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for InferenceUsageRecord