Struct ModelPolicy 

pub struct ModelPolicy {
    pub small: String,
    pub medium: String,
    pub large: String,
    pub allow_large: bool,
    pub max_latency_ms: Option<u64>,
    pub max_cost_tier: CostTier,
}

Policy for selecting models based on cost/quality tradeoffs.

Fields

small: String

Small/cheap model identifier.

medium: String

Medium model identifier.

large: String

Large/expensive model identifier.

allow_large: bool

Whether large model is allowed.

max_latency_ms: Option<u64>

Maximum latency budget in ms.

max_cost_tier: CostTier

Maximum cost tier allowed.

Implementations

impl ModelPolicy

pub fn model_for_tier(&self, tier: CostTier) -> &str

Get the appropriate model for the given cost tier.

pub fn with_small(self, model: impl Into<String>) -> Self

Set small model.

pub fn with_medium(self, model: impl Into<String>) -> Self

Set medium model.

pub fn with_large(self, model: impl Into<String>) -> Self

Set large model.

Trait Implementations

impl Clone for ModelPolicy

fn clone(&self) -> ModelPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModelPolicy

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ModelPolicy

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ModelPolicy

fn eq(&self, other: &ModelPolicy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ModelPolicy

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ModelPolicy