Enum ChunkStrategy 

pub enum ChunkStrategy {
    FixedSize(usize),
    Adaptive {
        min_size: usize,
        max_size: usize,
        target_memory: usize,
    },
    LineBased {
        max_lines: usize,
        max_bytes: usize,
    },
}

Strategy for chunking data.

Variants

FixedSize(usize)

Fixed-size chunks

Adaptive

Adaptive chunk size based on available memory

Fields

min_size: usize

Minimum chunk size in bytes

max_size: usize

Maximum chunk size in bytes

target_memory: usize

Target memory ceiling for the chunk size calculation

LineBased

Line-based chunking (for text data)

Fields

max_lines: usize

Maximum number of lines per chunk

max_bytes: usize

Maximum number of bytes per chunk

Implementations

impl ChunkStrategy

pub fn chunk_size_for_index( &self, _index: usize, available_memory: usize, ) -> usize

Get the chunk size for a given chunk index and available memory.

Trait Implementations

impl Clone for ChunkStrategy

fn clone(&self) -> ChunkStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChunkStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ChunkStrategy

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for ChunkStrategy

fn eq(&self, other: &ChunkStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for ChunkStrategy

impl Eq for ChunkStrategy

impl StructuralPartialEq for ChunkStrategy