Struct ModelRouter 

pub struct ModelRouter<S: LlmClient, F: LlmClient> { /* private fields */ }

Dual-model router that selects smart or fast model per request.

Implementations

impl<S: LlmClient, F: LlmClient> ModelRouter<S, F>

pub fn new(smart: S, fast: F) -> Self

pub fn with_config(self, config: RouterConfig) -> Self

pub fn route_messages(&self, messages: &[Message]) -> ModelChoice

Decide which model to use based on request characteristics.

pub fn route_tools( &self, messages: &[Message], tools: &[ToolDef], ) -> ModelChoice

Decide which model for tool calls based on tool count.

pub fn route_structured( &self, messages: &[Message], _schema: &Value, ) -> ModelChoice

Decide which model for structured calls.

Trait Implementations

impl<S: LlmClient, F: LlmClient> LlmClient for ModelRouter<S, F>

fn structured_call<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, messages: &'life1 [Message], schema: &'life2 Value, ) -> Pin<Box<dyn Future<Output = Result<(Option<Value>, Vec<ToolCall>, String), SgrError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Structured call: send messages with schema injected into system prompt. Returns (parsed_output, native_tool_calls, raw_text).

fn tools_call<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, messages: &'life1 [Message], tools: &'life2 [ToolDef], ) -> Pin<Box<dyn Future<Output = Result<Vec<ToolCall>, SgrError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Native function calling: send messages + tool defs, get tool calls.

fn complete<'life0, 'life1, 'async_trait>( &'life0 self, messages: &'life1 [Message], ) -> Pin<Box<dyn Future<Output = Result<String, SgrError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Plain text completion (no schema, no tools).