Struct ParallelChunker 

pub struct ParallelChunker { /* private fields */ }

Parallel chunker for high-performance file processing

Implementations

impl ParallelChunker

pub fn new() -> Self

Create a new parallel chunker with default configuration

pub fn with_config(config: ParallelChunkingConfig) -> Self

Create a parallel chunker with custom configuration

pub fn chunk_parallel(&self, data: &[u8]) -> Result<ParallelChunkingResult>

Chunk data in parallel

This splits the data into chunks and processes them concurrently using Rayon. For small files (< 1MB), sequential chunking is more efficient.

pub fn chunk_files_parallel( &self, files: &[Vec<u8>], ) -> Result<Vec<ParallelChunkingResult>>

Process multiple files in parallel

Trait Implementations

impl Default for ParallelChunker

fn default() -> Self

Returns the “default value” for a type.