Struct AdaptiveChunkingParams 

pub struct AdaptiveChunkingParams {
    pub target_memory_usage: usize,
    pub max_chunksize: usize,
    pub min_chunksize: usize,
    pub target_chunk_duration: Option<Duration>,
    pub consider_distribution: bool,
    pub optimize_for_parallel: bool,
    pub numworkers: Option<usize>,
}

Parameters for configuring adaptive chunking behavior.

Fields

target_memory_usage: usize

Target memory usage per chunk (in bytes)

max_chunksize: usize

Maximum chunk size (in elements)

min_chunksize: usize

Minimum chunk size (in elements)

target_chunk_duration: Option<Duration>

Target processing time per chunk (for time-based adaptation)

consider_distribution: bool

Whether to consider data distribution (can be expensive to calculate)

optimize_for_parallel: bool

Whether to adjust for parallel processing

numworkers: Option<usize>

Number of worker threads to optimize for (when parallel is enabled)

Implementations

impl AdaptiveChunkingParams

pub fn for_workload(workload: WorkloadType) -> Self

Beta 2: Create optimized parameters for specific workload types

Trait Implementations

impl Clone for AdaptiveChunkingParams

fn clone(&self) -> AdaptiveChunkingParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AdaptiveChunkingParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AdaptiveChunkingParams

fn default() -> Self

Returns the “default value” for a type.