pub enum RoutingError {
ModelNotFound {
model: String,
},
NoHealthyBackend {
model: String,
},
CapabilityMismatch {
model: String,
missing: Vec<String>,
},
FallbackChainExhausted {
chain: Vec<String>,
},
Reject {
rejection_reasons: Vec<RejectionReason>,
},
Queue {
reason: String,
estimated_wait_ms: u64,
},
}Expand description
Errors that can occur during backend selection
Variants§
ModelNotFound
The requested model was not found in any backend
NoHealthyBackend
No healthy backend is available for the requested model
CapabilityMismatch
No backend supports the required capabilities
FallbackChainExhausted
All models in the fallback chain were exhausted
Reject
Request rejected with detailed reasons from reconcilers (FR-004)
Fields
§
rejection_reasons: Vec<RejectionReason>Queue
Request should be queued (all backends at capacity, queue enabled)
Trait Implementations§
Source§impl Debug for RoutingError
impl Debug for RoutingError
Source§impl Display for RoutingError
impl Display for RoutingError
Source§impl Error for RoutingError
impl Error for RoutingError
1.30.0 · Source§fn source(&self) -> Option<&(dyn Error + 'static)>
fn source(&self) -> Option<&(dyn Error + 'static)>
Returns the lower-level source of this error, if any. Read more
1.0.0 · Source§fn description(&self) -> &str
fn description(&self) -> &str
👎Deprecated since 1.42.0: use the Display impl or to_string()
Auto Trait Implementations§
impl Freeze for RoutingError
impl RefUnwindSafe for RoutingError
impl Send for RoutingError
impl Sync for RoutingError
impl Unpin for RoutingError
impl UnsafeUnpin for RoutingError
impl UnwindSafe for RoutingError
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
Source§impl<T> ToStringFallible for Twhere
T: Display,
impl<T> ToStringFallible for Twhere
T: Display,
Source§fn try_to_string(&self) -> Result<String, TryReserveError>
fn try_to_string(&self) -> Result<String, TryReserveError>
ToString::to_string, but without panic on OOM.