pub enum RoutingStrategy {
Priority,
LowestLatency,
BestAccuracy,
RoundRobin,
Random,
Cascade,
ContentBased,
}Expand description
Model routing strategy.
Variants§
Priority
Route to model with highest priority
LowestLatency
Route to model with lowest latency
BestAccuracy
Route to model with best accuracy (requires profiling)
RoundRobin
Round-robin across models
Random
Random selection
Cascade
Cascade (try fast model first, fallback to accurate)
ContentBased
Route based on input features
Trait Implementations§
Source§impl Clone for RoutingStrategy
impl Clone for RoutingStrategy
impl Copy for RoutingStrategy
Source§impl Debug for RoutingStrategy
impl Debug for RoutingStrategy
Source§impl<'de> Deserialize<'de> for RoutingStrategy
impl<'de> Deserialize<'de> for RoutingStrategy
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for RoutingStrategy
Source§impl PartialEq for RoutingStrategy
impl PartialEq for RoutingStrategy
Source§impl Serialize for RoutingStrategy
impl Serialize for RoutingStrategy
impl StructuralPartialEq for RoutingStrategy
Auto Trait Implementations§
impl Freeze for RoutingStrategy
impl RefUnwindSafe for RoutingStrategy
impl Send for RoutingStrategy
impl Sync for RoutingStrategy
impl Unpin for RoutingStrategy
impl UnsafeUnpin for RoutingStrategy
impl UnwindSafe for RoutingStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more