Struct ModelInfo 

pub struct ModelInfo {
    pub id: String,
    pub provider: String,
    pub name: String,
    pub context_length: u32,
    pub input_cost_per_1k: Option<f64>,
    pub output_cost_per_1k: Option<f64>,
    pub supports_tools: bool,
    pub supports_vision: bool,
    pub supports_streaming: bool,
}

Model information for routing and selection.

Fields

id: String

Model identifier

provider: String

Provider name

name: String

Human-readable name

context_length: u32

Maximum context length in tokens

input_cost_per_1k: Option<f64>

Cost per 1K input tokens (in USD)

output_cost_per_1k: Option<f64>

Cost per 1K output tokens (in USD)

supports_tools: bool

Whether the model supports tools

supports_vision: bool

Whether the model supports vision

supports_streaming: bool

Whether the model supports streaming

Implementations

impl ModelInfo

pub fn estimate_cost( &self, input_tokens: u32, output_tokens: u32, ) -> Option<f64>

Estimate cost for a request.

Trait Implementations

impl Clone for ModelInfo

fn clone(&self) -> ModelInfo

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelInfo

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.