Struct ModelPricing 

pub struct ModelPricing {
    pub input_per_million: u64,
    pub output_per_million: u64,
    pub cache_read_per_million: Option<u64>,
}

Pricing information for a specific model.

All prices are in microdollars per million tokens. For example, a price of $3.00 per million input tokens would be 3_000_000.

Example

use llm_stack::usage::{ModelPricing, Usage};

// Claude 3.5 Sonnet pricing (as of early 2024)
let pricing = ModelPricing {
    input_per_million: 3_000_000,   // $3.00 / MTok
    output_per_million: 15_000_000, // $15.00 / MTok
    cache_read_per_million: Some(300_000), // $0.30 / MTok
};

let usage = Usage {
    input_tokens: 1_000_000,
    output_tokens: 100_000,
    ..Default::default()
};

let cost = pricing.compute_cost(&usage).unwrap();
assert_eq!(cost.total_microdollars(), 4_500_000); // $3 input + $1.50 output

Fields

input_per_million: u64

Cost per million input tokens in microdollars.

output_per_million: u64

Cost per million output tokens in microdollars.

cache_read_per_million: Option<u64>

Cost per million cache-read tokens in microdollars (if applicable).

Implementations

impl ModelPricing

pub fn compute_cost(&self, usage: &Usage) -> Option<Cost>

Computes the cost for the given usage.

Returns None if the calculation would overflow.

Trait Implementations

impl Clone for ModelPricing

fn clone(&self) -> ModelPricing

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelPricing

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ModelPricing

fn eq(&self, other: &ModelPricing) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for ModelPricing

impl StructuralPartialEq for ModelPricing