pub struct RunTimings {
pub queue_wait: Duration,
pub resize: Duration,
pub input_copy: Duration,
pub inference: Duration,
pub output_copy: Duration,
}Expand description
Measured wall times for one accepted request.
Fields§
§queue_wait: DurationQueue and cross-model gate wait, excluding caller-side validation/allocation.
resize: DurationResizing native tensors and preparing the session for the request.
input_copy: DurationCopying inputs into MNN (including layout conversion/upload).
inference: DurationNative session execution (some GPU work can finish during output copy).
output_copy: DurationDownloading/converting output values.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for RunTimings
impl RefUnwindSafe for RunTimings
impl Send for RunTimings
impl Sync for RunTimings
impl Unpin for RunTimings
impl UnsafeUnpin for RunTimings
impl UnwindSafe for RunTimings
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more