pub struct RoutingTaskRecord {
pub task_id: String,
pub tier: String,
pub serving_model: String,
pub routed: bool,
pub requested_input_rate: f64,
pub serving_input_rate: f64,
pub input_rate_saving_per_mtok: f64,
}Expand description
One task’s routing decision + rate delta.
Fields§
§task_id: String§tier: StringIntent tier the production classifier assigned (fast|standard|premium).
serving_model: StringModel serving the on-arm (= requested when the router kept it).
routed: boolTrue when the router changed the model (alias or tier hit).
requested_input_rate: f64List input rate (USD/MTok) of the requested model.
serving_input_rate: f64List input rate (USD/MTok) of the serving model.
input_rate_saving_per_mtok: f64Rate-card saving per 1M input tokens for this task (0 when kept).
Trait Implementations§
Source§impl Clone for RoutingTaskRecord
impl Clone for RoutingTaskRecord
Source§fn clone(&self) -> RoutingTaskRecord
fn clone(&self) -> RoutingTaskRecord
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for RoutingTaskRecord
impl Debug for RoutingTaskRecord
Source§impl<'de> Deserialize<'de> for RoutingTaskRecord
impl<'de> Deserialize<'de> for RoutingTaskRecord
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for RoutingTaskRecord
impl RefUnwindSafe for RoutingTaskRecord
impl Send for RoutingTaskRecord
impl Sync for RoutingTaskRecord
impl Unpin for RoutingTaskRecord
impl UnsafeUnpin for RoutingTaskRecord
impl UnwindSafe for RoutingTaskRecord
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
impl<A, B, T> HttpServerConnExec<A, B> for Twhere
B: Body,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more