pub enum RoutingStrategy {
Fallback,
CostOptimized,
LatencyOptimized,
RoundRobin,
AbSplit {
primary_weight: f32,
},
}Expand description
Routing strategy for model selection.
Variants§
Fallback
Use the primary model; fall back to alternatives on failure.
CostOptimized
Route to the lowest-cost provider.
LatencyOptimized
Route to the lowest-latency provider.
RoundRobin
Round-robin across providers.
AbSplit
A/B split by percentage.
Trait Implementations§
Source§impl Clone for RoutingStrategy
impl Clone for RoutingStrategy
Source§fn clone(&self) -> RoutingStrategy
fn clone(&self) -> RoutingStrategy
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RoutingStrategy
impl Debug for RoutingStrategy
Source§impl<'de> Deserialize<'de> for RoutingStrategy
impl<'de> Deserialize<'de> for RoutingStrategy
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for RoutingStrategy
impl PartialEq for RoutingStrategy
Source§impl Serialize for RoutingStrategy
impl Serialize for RoutingStrategy
impl StructuralPartialEq for RoutingStrategy
Auto Trait Implementations§
impl Freeze for RoutingStrategy
impl RefUnwindSafe for RoutingStrategy
impl Send for RoutingStrategy
impl Sync for RoutingStrategy
impl Unpin for RoutingStrategy
impl UnsafeUnpin for RoutingStrategy
impl UnwindSafe for RoutingStrategy
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request