pub struct RoutingConfig {
pub strategy: RoutingStrategy,
pub default_importance: Importance,
pub router_timeouts: RouterTimeouts,
/* private fields */
}Expand description
Routing configuration
Fields§
§strategy: RoutingStrategy§default_importance: Importance§router_timeouts: RouterTimeoutsRouter query timeout configuration per tier
Defaults to 10s for all tiers if not specified (backward compatible). Can be customized per tier to accommodate different model response times.
Implementations§
Source§impl RoutingConfig
impl RoutingConfig
Sourcepub fn router_tier(&self) -> TargetModel
pub fn router_tier(&self) -> TargetModel
Get the router tier for LLM-based routing decisions
The router tier determines which model tier (Fast/Balanced/Deep) is used to make routing decisions in LLM and Hybrid strategies.
§Returns
The configured router tier (validated during config loading)
Sourcepub fn router_timeout_for_tier(&self, tier: TargetModel) -> u64
pub fn router_timeout_for_tier(&self, tier: TargetModel) -> u64
Trait Implementations§
Source§impl Clone for RoutingConfig
impl Clone for RoutingConfig
Source§fn clone(&self) -> RoutingConfig
fn clone(&self) -> RoutingConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RoutingConfig
impl Debug for RoutingConfig
Source§impl<'de> Deserialize<'de> for RoutingConfig
impl<'de> Deserialize<'de> for RoutingConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for RoutingConfig
impl RefUnwindSafe for RoutingConfig
impl Send for RoutingConfig
impl Sync for RoutingConfig
impl Unpin for RoutingConfig
impl UnwindSafe for RoutingConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more