Struct InferenceMemoryTracker 

pub struct InferenceMemoryTracker {
    pub events: Vec<AllocEvent>,
    pub regions: HashMap<u64, RegionInfo>,
    pub live_bytes: u64,
    pub peak_bytes: u64,
    pub stats: TrackerStats,
}

Tracks memory allocations made during a single inference session.

Record AllocEvents via InferenceMemoryTracker::record, then query the current state via InferenceMemoryTracker::snapshot, InferenceMemoryTracker::leaked_regions, and InferenceMemoryTracker::memory_by_rule.

Fields

events: Vec<AllocEvent>

Full, ordered event log.

regions: HashMap<u64, RegionInfo>

Map from region_id to its RegionInfo.

live_bytes: u64

Current live byte total.

peak_bytes: u64

Highest live_bytes value seen so far.

stats: TrackerStats

Aggregate counters.

Implementations

impl InferenceMemoryTracker

pub fn new() -> Self

Creates a new, empty tracker.

pub fn record(&mut self, event: AllocEvent)

Records an event and updates internal state accordingly.

• AllocEvent::Alloc: inserts a new RegionInfo, increases live_bytes, and updates peak_bytes.
• AllocEvent::Free: marks the region freed and decreases live_bytes. Silently ignored when the region is not found or already freed (double-free).
• AllocEvent::Checkpoint: just appended to the event log.

pub fn snapshot(&self) -> MemorySnapshot

Returns a snapshot of the current memory state.

leaked_bytes is the sum of size_bytes for every region that has never been freed.

pub fn memory_by_rule(&self, rule_id: u64) -> u64

Returns the total bytes currently held by live regions associated with the given rule_id.

pub fn leaked_regions(&self) -> Vec<&RegionInfo>

Returns references to all regions that have not been freed.

pub fn stats(&self) -> &TrackerStats

Returns a reference to the aggregate counters.

pub fn reset(&mut self)

Resets all state so the tracker can be reused for a new session.

Trait Implementations

impl Debug for InferenceMemoryTracker

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InferenceMemoryTracker

fn default() -> Self

Returns the “default value” for a type.