pub struct MemoryAnalysis {
pub total_memory_usage: u64,
pub peak_memory_usage: u64,
pub memory_by_operation: HashMap<OperationType, u64>,
pub memory_hotspots: Vec<(String, u64)>,
pub fragmentation_ratio: Option<f64>,
pub optimization_suggestions: Vec<String>,
}Expand description
Memory usage analysis
Fields§
§total_memory_usage: u64Total memory usage in bytes
peak_memory_usage: u64Peak simultaneously-live memory usage in bytes, computed by a real
liveness walk over the graph’s topological order (see
ComputationGraphAnalyzer::compute_peak_memory_usage): a node’s
output is “live” from the step it is produced until the step of its
last consumer, and this is the maximum total live bytes at any one
step. Never equal to total_memory_usage by construction (as the
old placeholder was) unless every tensor really is live
simultaneously.
memory_by_operation: HashMap<OperationType, u64>Memory usage by operation type
memory_hotspots: Vec<(String, u64)>Nodes with highest memory usage
fragmentation_ratio: Option<f64>Memory fragmentation ratio, when measurable. This analyzer tracks
only logical per-node byte counts, not a real memory
allocator/placement model (address ranges, allocation order,
free-list state) – fragmentation is a property of how an
allocator places live tensors in physical memory, which is a
different question from liveness overlap (already captured by
Self::peak_memory_usage) and depends on a placement policy this
crate does not implement. Honestly None rather than a fabricated
number.
optimization_suggestions: Vec<String>Suggested memory optimizations
Trait Implementations§
Source§impl Clone for MemoryAnalysis
impl Clone for MemoryAnalysis
Source§fn clone(&self) -> MemoryAnalysis
fn clone(&self) -> MemoryAnalysis
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreSource§impl Debug for MemoryAnalysis
impl Debug for MemoryAnalysis
Source§impl<'de> Deserialize<'de> for MemoryAnalysis
impl<'de> Deserialize<'de> for MemoryAnalysis
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Auto Trait Implementations§
impl Freeze for MemoryAnalysis
impl RefUnwindSafe for MemoryAnalysis
impl Send for MemoryAnalysis
impl Sync for MemoryAnalysis
impl Unpin for MemoryAnalysis
impl UnsafeUnpin for MemoryAnalysis
impl UnwindSafe for MemoryAnalysis
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
Source§fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
Source§fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
self to the equivalent element of its superset.Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
self to the equivalent element of its superset.