Struct PoolingPolicy 

pub struct PoolingPolicy {
    pub min_size_bytes: usize,
    pub max_size_bytes: usize,
    pub min_frequency: usize,
    pub memory_pressure_threshold: f64,
    pub adaptive: bool,
}

Policy for determining when to use buffer pooling

Fields

min_size_bytes: usize

Minimum buffer size in bytes to pool

max_size_bytes: usize

Maximum buffer size in bytes to pool

min_frequency: usize

Minimum access frequency for a shape

memory_pressure_threshold: f64

Available memory threshold (0.0-1.0) Don’t pool aggressively if available memory is low

adaptive: bool

Enable adaptive thresholds based on runtime behavior

Implementations

impl PoolingPolicy

pub fn new() -> Self

Create a new pooling policy with default settings

pub fn conservative() -> Self

Create a conservative policy (pool only large, frequently accessed buffers)

pub fn aggressive() -> Self

Create an aggressive policy (pool most buffers)

pub fn memory_constrained() -> Self

Create a memory-constrained policy (minimize memory usage)

pub fn should_pool(&self, shape: &[usize], elem_size: usize) -> bool

Determine if a buffer should be pooled based on its characteristics

Arguments

• shape - Buffer shape
• elem_size - Size of each element in bytes

Returns

true if the buffer should be pooled, false otherwise

pub fn should_pool_with_frequency( &self, shape: &[usize], elem_size: usize, frequency: usize, ) -> bool

Check if we should pool based on access frequency

This should be called after tracking access patterns.

pub fn with_memory_pressure(&self, available_memory_ratio: f64) -> Self

Adjust thresholds based on memory pressure

Arguments

• available_memory_ratio - Fraction of memory available (0.0-1.0)

Returns

Adjusted policy with modified thresholds

Trait Implementations

impl Clone for PoolingPolicy

fn clone(&self) -> PoolingPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PoolingPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for PoolingPolicy

fn default() -> Self

Returns the “default value” for a type.