pub struct ForwardPassMetrics {
pub version: u32,
pub worker_id: String,
pub dp_rank: u32,
pub counter_id: u64,
pub wall_time: f64,
pub scheduled_requests: ScheduledRequestMetrics,
pub queued_requests: QueuedRequestMetrics,
}Expand description
Per-iteration forward-pass metrics.
In Dynamo this struct is telemetry emitted after an engine iteration. In
AIC the scheduled portion is also the estimator input. wall_time and
queued_requests are accepted for schema parity but ignored by the
latency estimator (the forward-pass perf model uses wall_time as the
tuning target, never as an estimation input).
Fields§
§version: u32§worker_id: String§dp_rank: u32§counter_id: u64§wall_time: f64§scheduled_requests: ScheduledRequestMetrics§queued_requests: QueuedRequestMetricsTrait Implementations§
Source§impl Clone for ForwardPassMetrics
impl Clone for ForwardPassMetrics
Source§fn clone(&self) -> ForwardPassMetrics
fn clone(&self) -> ForwardPassMetrics
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ForwardPassMetrics
impl Debug for ForwardPassMetrics
Source§impl Default for ForwardPassMetrics
impl Default for ForwardPassMetrics
Source§impl<'de> Deserialize<'de> for ForwardPassMetrics
impl<'de> Deserialize<'de> for ForwardPassMetrics
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for ForwardPassMetrics
impl PartialEq for ForwardPassMetrics
Source§impl Serialize for ForwardPassMetrics
impl Serialize for ForwardPassMetrics
impl StructuralPartialEq for ForwardPassMetrics
Auto Trait Implementations§
impl Freeze for ForwardPassMetrics
impl RefUnwindSafe for ForwardPassMetrics
impl Send for ForwardPassMetrics
impl Sync for ForwardPassMetrics
impl Unpin for ForwardPassMetrics
impl UnsafeUnpin for ForwardPassMetrics
impl UnwindSafe for ForwardPassMetrics
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more