pub struct Stats {
pub attn_graph_calls: u64,
pub attn_graph_rows: u64,
pub attn_graph_ns: u64,
pub calls: u64,
pub picks: u64,
pub hits: u64,
pub fills: u64,
pub cold: u64,
pub frame_ns: u64,
pub call_ns: u64,
pub fallbacks: u64,
pub route_ns: u64,
}Expand description
Per-process counters of the dynamic executor.
Fields§
§attn_graph_calls: u64Completed attention-only graph calls / rows in the dynamic tail.
attn_graph_rows: u64§attn_graph_ns: u64§calls: u64Layer calls served by the bank frame.
picks: u64Expert picks seen by those calls.
hits: u64Picks already resident before the call.
fills: u64Picks uploaded into the bank by the call (then run on the device).
cold: u64Picks computed on the host.
frame_ns: u64Wall time inside the device frame (submit + wait), ns.
call_ns: u64Wall time of the whole layer call, ns.
fallbacks: u64Calls that fell back to the host path.
route_ns: u64Wall time of the host route (router matvec + top-k) of bank calls, ns.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for Stats
impl RefUnwindSafe for Stats
impl Send for Stats
impl Sync for Stats
impl Unpin for Stats
impl UnsafeUnpin for Stats
impl UnwindSafe for Stats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more