pub struct ModelRouterCandidate {
pub id: Uuid,
pub model_id: ModelId,
pub request_overrides: Value,
pub weight: i32,
pub rules: Option<Value>,
pub position: i32,
pub created_at: DateTime<Utc>,
pub updated_at: DateTime<Utc>,
}Expand description
An ordered candidate inside a route. References a concrete model and may
carry provider-agnostic request overrides plus a weight (for weighted)
or rules (for rules).
Fields§
§id: Uuid§model_id: ModelIdThe concrete model to invoke.
request_overrides: ValueProvider-agnostic overrides applied at LLM-call time
(reasoning_effort, temperature, max_output_tokens, …).
Defaults to an empty object so missing fields stay object-shaped on
the wire, matching the DB JSONB default of {}.
weight: i32Used by weighted strategy. Defaults to 1 (uniform).
rules: Option<Value>Used by rules strategy. None for other strategies.
position: i32Used by ordered_fallback strategy.
created_at: DateTime<Utc>§updated_at: DateTime<Utc>Trait Implementations§
Source§impl Clone for ModelRouterCandidate
impl Clone for ModelRouterCandidate
Source§fn clone(&self) -> ModelRouterCandidate
fn clone(&self) -> ModelRouterCandidate
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelRouterCandidate
impl Debug for ModelRouterCandidate
Source§impl<'de> Deserialize<'de> for ModelRouterCandidate
impl<'de> Deserialize<'de> for ModelRouterCandidate
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for ModelRouterCandidate
impl RefUnwindSafe for ModelRouterCandidate
impl Send for ModelRouterCandidate
impl Sync for ModelRouterCandidate
impl Unpin for ModelRouterCandidate
impl UnsafeUnpin for ModelRouterCandidate
impl UnwindSafe for ModelRouterCandidate
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request