Struct AdaptiveChunkingParams 

pub struct AdaptiveChunkingParams {
    pub target_memory_usage: usize,
    pub max_chunksize: usize,
    pub min_chunksize: usize,
    pub target_chunk_duration: Option<Duration>,
    pub consider_distribution: bool,
    pub optimize_for_parallel: bool,
    pub numworkers: Option<usize>,
    pub predictor: Option<SharedPredictor>,
    pub memory_limits: Option<MemoryLimits>,
    pub enable_oom_prevention: bool,
    pub enable_dynamic_adjustment: bool,
    pub memory_monitor: Option<SharedMemoryMonitor>,
}

Parameters for configuring adaptive chunking behavior.

Fields

target_memory_usage: usize

Target memory usage per chunk (in bytes)

max_chunksize: usize

Maximum chunk size (in elements)

min_chunksize: usize

Minimum chunk size (in elements)

target_chunk_duration: Option<Duration>

Target processing time per chunk (for time-based adaptation)

consider_distribution: bool

Whether to consider data distribution (can be expensive to calculate)

optimize_for_parallel: bool

Whether to adjust for parallel processing

numworkers: Option<usize>

Number of worker threads to optimize for (when parallel is enabled)

predictor: Option<SharedPredictor>

Optional chunk size predictor for adaptive feedback

memory_limits: Option<MemoryLimits>

Memory limits configuration for OOM prevention

enable_oom_prevention: bool

Whether to enable OOM prevention mechanisms

enable_dynamic_adjustment: bool

Whether to enable dynamic chunk size adjustment during processing

memory_monitor: Option<SharedMemoryMonitor>

Shared memory pressure monitor (optional, for multi-threaded use)

Implementations

impl AdaptiveChunkingParams

pub fn detect_available_memory() -> Option<usize>

Beta 2: Detect available system memory using cross-platform detection

pub fn for_workload(workload: WorkloadType) -> Self

Beta 2: Create optimized parameters for specific workload types

Trait Implementations

impl Clone for AdaptiveChunkingParams

fn clone(&self) -> AdaptiveChunkingParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AdaptiveChunkingParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AdaptiveChunkingParams

fn default() -> Self

Returns the “default value” for a type.