pub struct ModelRouter { /* private fields */ }Expand description
Ordered, provider-neutral fallback routing behind the canonical Model
boundary.
Implementations§
Source§impl ModelRouter
impl ModelRouter
Sourcepub fn builder(logical: ModelRef) -> ModelRouterBuilder
pub fn builder(logical: ModelRef) -> ModelRouterBuilder
Starts a router builder for one logical model identity.
Sourcepub const fn logical_model(&self) -> &ModelRef
pub const fn logical_model(&self) -> &ModelRef
Returns the identity applications use in ModelRequest.
Sourcepub fn routes(&self) -> &[ModelRoute]
pub fn routes(&self) -> &[ModelRoute]
Returns physical routes in deterministic selection order.
Sourcepub fn route_health(&self) -> Vec<ModelRouteHealth>
pub fn route_health(&self) -> Vec<ModelRouteHealth>
Returns a point-in-time health snapshot for every physical route.
Trait Implementations§
Source§impl Clone for ModelRouter
impl Clone for ModelRouter
Source§fn clone(&self) -> ModelRouter
fn clone(&self) -> ModelRouter
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelRouter
impl Debug for ModelRouter
Source§impl Model for ModelRouter
impl Model for ModelRouter
Source§fn capabilities<'a>(
&'a self,
model: &'a ModelRef,
) -> ModelFuture<'a, Result<ModelCapabilities, ModelError>>
fn capabilities<'a>( &'a self, model: &'a ModelRef, ) -> ModelFuture<'a, Result<ModelCapabilities, ModelError>>
Resolves capabilities for a provider-qualified model.
Source§fn stream(
&self,
request: ModelRequest,
context: ModelCallContext,
) -> ModelFuture<'_, Result<ModelEventStream, ModelError>>
fn stream( &self, request: ModelRequest, context: ModelCallContext, ) -> ModelFuture<'_, Result<ModelEventStream, ModelError>>
Opens a canonical event stream for a request.
Source§fn invoke(
&self,
request: ModelRequest,
context: ModelCallContext,
) -> ModelFuture<'_, Result<ModelResponse, ModelError>>
fn invoke( &self, request: ModelRequest, context: ModelCallContext, ) -> ModelFuture<'_, Result<ModelResponse, ModelError>>
Invokes the model and reconstructs its terminal response.
Auto Trait Implementations§
impl !RefUnwindSafe for ModelRouter
impl !UnwindSafe for ModelRouter
impl Freeze for ModelRouter
impl Send for ModelRouter
impl Sync for ModelRouter
impl Unpin for ModelRouter
impl UnsafeUnpin for ModelRouter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more