Struct StreamingValidationOperation 

pub struct StreamingValidationOperation {
    pub strict: bool,
}

Streaming validation operation for memory-efficient validation of large files.

Uses the streaming parser from hedl-stream to validate files with O(1) memory usage regardless of file size. Ideal for:

• Files larger than 100MB
• Validating thousands of files with limited RAM
• Container environments with memory limits

Memory Profile

• Input: O(1) - buffer size only (~8KB)
• Working: O(n_ids) - seen ID set for strict validation
• Output: O(1) - small statistics struct
• Peak: ~8KB + ID set size (vs. full file size in standard mode)

Examples

use hedl_cli::batch::{BatchExecutor, StreamingValidationOperation};
use std::path::PathBuf;

let processor = BatchExecutor::default_config();
let files = vec![PathBuf::from("large-file.hedl")];

let operation = StreamingValidationOperation { strict: false };
let results = processor.process_streaming(&files, operation, true)?;

println!("Validated {} files with constant memory", results.success_count());

Fields

strict: bool

Enable strict reference validation

Trait Implementations

impl Clone for StreamingValidationOperation

fn clone(&self) -> StreamingValidationOperation

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for StreamingValidationOperation

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl StreamingBatchOperation for StreamingValidationOperation

type Output = ValidationStats

The output type for successful processing

fn process_file_streaming(&self, path: &Path) -> Result<Self::Output, CliError>

Process a file using streaming parser.

fn name(&self) -> &'static str

Get operation name for progress reporting

fn supports_streaming(&self) -> bool

Indicate if this operation can run in streaming mode.