pub struct ResidencyReport {
pub total_bytes: usize,
pub peak_bytes: usize,
pub peak_op_index: usize,
pub eviction_candidates: Vec<LiveRange>,
}Expand description
Structured report on a graph’s residency profile.
Fields§
§total_bytes: usizeTotal bytes of storage summed over every reachable op’s output. Not the peak — this is cumulative if nothing were freed.
peak_bytes: usizeMaximum bytes live simultaneously at any point during a single-device execution of the graph. The minimum VRAM (or “primary device”) required to run without spilling.
peak_op_index: usizeOp position (index in topo order) where the peak occurs.
eviction_candidates: Vec<LiveRange>Per-tensor live range, sorted by bytes * inactive_gap
descending (biggest “wasted residency” candidates first).
insert_residency_evictions consumes this list.
Implementations§
Trait Implementations§
Source§impl Clone for ResidencyReport
impl Clone for ResidencyReport
Auto Trait Implementations§
impl Freeze for ResidencyReport
impl RefUnwindSafe for ResidencyReport
impl Send for ResidencyReport
impl Sync for ResidencyReport
impl Unpin for ResidencyReport
impl UnsafeUnpin for ResidencyReport
impl UnwindSafe for ResidencyReport
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more