Struct ModelRouter 

pub struct ModelRouter { /* private fields */ }

Available on crate feature agent only.

Smart router for selecting optimal models.

Analyzes tasks and routes them to the most appropriate model based on complexity, cost, and latency requirements.

Implementations

impl ModelRouter

pub fn new() -> ModelRouter

Create a new router with default settings.

pub fn with_policy(policy: ModelPolicy) -> ModelRouter

Create with custom policy.

pub fn with_thresholds(self, medium: usize, large: usize) -> ModelRouter

Set token thresholds.

pub fn policy(&self) -> &ModelPolicy

Get a reference to the underlying policy.

pub fn enabled(self, enabled: bool) -> ModelRouter

Enable or disable smart routing.

pub fn route(&self, task: &TaskAnalysis) -> RoutingDecision

Route a task to the optimal model.

Returns the recommended model name.

pub fn route_simple(&self, prompt: &str) -> RoutingDecision

Quickly route a simple prompt.

Trait Implementations

impl Clone for ModelRouter

fn clone(&self) -> ModelRouter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelRouter

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for ModelRouter

fn default() -> ModelRouter

Returns the “default value” for a type.