pub struct MemoryPoolStats {Show 15 fields
pub total_tensors: usize,
pub total_shapes: usize,
pub current_size_bytes: usize,
pub max_size_bytes: usize,
pub dynamic_max_size_bytes: usize,
pub utilization: f64,
pub hit_rate: f64,
pub miss_rate: f64,
pub total_requests: usize,
pub cache_hits: usize,
pub cache_misses: usize,
pub total_evictions: usize,
pub peak_memory_usage_bytes: usize,
pub eviction_policy: MemoryEvictionPolicy,
pub adaptive_strategy: AdaptiveStrategy,
}Expand description
Enhanced statistics for memory pool
Fields§
§total_tensors: usizeTotal tensors currently in pool
total_shapes: usizeNumber of different tensor shapes in pool
current_size_bytes: usizeCurrent memory usage in bytes
max_size_bytes: usizeMaximum configured pool size in bytes
dynamic_max_size_bytes: usizeCurrent dynamic maximum size (for adaptive strategies)
utilization: f64Pool utilization (0.0 to 1.0+)
hit_rate: f64Cache hit rate (0.0 to 1.0)
miss_rate: f64Cache miss rate (0.0 to 1.0)
total_requests: usizeTotal number of tensor requests
cache_hits: usizeNumber of cache hits
cache_misses: usizeNumber of cache misses
total_evictions: usizeTotal number of evictions
peak_memory_usage_bytes: usizePeak memory usage observed (bytes)
eviction_policy: MemoryEvictionPolicyCurrent eviction policy
adaptive_strategy: AdaptiveStrategyCurrent adaptive strategy
Trait Implementations§
Source§impl Clone for MemoryPoolStats
impl Clone for MemoryPoolStats
Source§fn clone(&self) -> MemoryPoolStats
fn clone(&self) -> MemoryPoolStats
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for MemoryPoolStats
impl RefUnwindSafe for MemoryPoolStats
impl Send for MemoryPoolStats
impl Sync for MemoryPoolStats
impl Unpin for MemoryPoolStats
impl UnsafeUnpin for MemoryPoolStats
impl UnwindSafe for MemoryPoolStats
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more