pub enum RoutingStrategy {
Priority,
LowestLatency,
BestAccuracy,
RoundRobin,
Random,
Cascade,
ContentBased,
}Expand description
Model routing strategy.
Variants§
Priority
Route to model with highest priority
LowestLatency
Route to model with lowest latency
BestAccuracy
Route to model with best accuracy (requires profiling)
RoundRobin
Round-robin across models
Random
Random selection
Cascade
Cascade (try fast model first, fallback to accurate)
ContentBased
Route based on input features
Trait Implementations§
Source§impl Clone for RoutingStrategy
impl Clone for RoutingStrategy
Source§fn clone(&self) -> RoutingStrategy
fn clone(&self) -> RoutingStrategy
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RoutingStrategy
impl Debug for RoutingStrategy
Source§impl<'de> Deserialize<'de> for RoutingStrategy
impl<'de> Deserialize<'de> for RoutingStrategy
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for RoutingStrategy
impl PartialEq for RoutingStrategy
Source§impl Serialize for RoutingStrategy
impl Serialize for RoutingStrategy
impl Copy for RoutingStrategy
impl Eq for RoutingStrategy
impl StructuralPartialEq for RoutingStrategy
Auto Trait Implementations§
impl Freeze for RoutingStrategy
impl RefUnwindSafe for RoutingStrategy
impl Send for RoutingStrategy
impl Sync for RoutingStrategy
impl Unpin for RoutingStrategy
impl UnwindSafe for RoutingStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more