Struct MemoryEstimate 

pub struct MemoryEstimate {
    pub total_bytes: usize,
    pub peak_bytes: usize,
    pub intermediate_count: usize,
    pub max_tensor_size: usize,
    pub total_elements: usize,
}

Detailed memory estimate for an expression.

Fields

total_bytes: usize

Total memory needed for all tensors (in bytes)

peak_bytes: usize

Peak memory usage during execution (in bytes)

intermediate_count: usize

Number of intermediate tensors

max_tensor_size: usize

Maximum tensor size (in elements)

total_elements: usize

Total number of elements across all tensors

Implementations

impl MemoryEstimate

pub fn total_mb(&self) -> f64

Get total memory in megabytes.

pub fn peak_mb(&self) -> f64

Get peak memory in megabytes.

pub fn exceeds_limit(&self, limit_bytes: usize) -> bool

Check if this exceeds a memory limit (in bytes).

pub fn suggest_batch_size( &self, budget_bytes: usize, current_batch: usize, ) -> usize

Suggest optimal batch size given a memory budget.

Trait Implementations

impl Clone for MemoryEstimate

fn clone(&self) -> MemoryEstimate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MemoryEstimate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for MemoryEstimate

fn default() -> MemoryEstimate

Returns the “default value” for a type.

impl Display for MemoryEstimate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.