Struct StreamingRdfLoader 

pub struct StreamingRdfLoader { /* private fields */ }

Streaming RDF loader for memory-efficient processing.

This loader processes RDF data in chunks, allowing you to handle large datasets without loading everything into memory.

Implementations

impl StreamingRdfLoader

pub fn new() -> Self

Create a new streaming loader with default settings.

pub fn with_batch_size(self, size: usize) -> Self

Set the batch size for chunked processing.

Larger batches are more efficient but use more memory. Default is 1000 triples per batch.

pub fn on_triple<F>(self, handler: F) -> Self

where F: FnMut(&str, &str, &str) + Send + 'static,

Set a handler for individual triples.

The handler receives (subject, predicate, object) as strings.

pub fn on_batch<F>(self, handler: F) -> Self

where F: FnMut(&[Triple]) + Send + 'static,

Set a handler for triple batches.

The handler receives a slice of Triple objects.

pub fn on_progress<F>(self, handler: F) -> Self

where F: FnMut(&StreamStats) + Send + 'static,

Set a handler for progress updates.

The handler is called every progress_interval triples.

pub fn with_progress_interval(self, interval: usize) -> Self

Set the interval for progress updates.

Default is every 10000 triples.

pub fn collect_into_graph(self) -> Self

Enable collecting triples into a graph.

This is useful when you need the complete graph after streaming. Note: This increases memory usage.

pub fn filter_predicates(self, predicates: Vec<String>) -> Self

Filter to only process triples with specific predicates.

pub fn filter_subject_prefix(self, prefix: String) -> Self

Filter to only process triples whose subject starts with a prefix.

pub fn process_turtle( &mut self, data: &str, ) -> Result<(StreamStats, Option<Graph>)>

Process Turtle data from a string.

pub fn process_turtle_reader<R: BufRead>( &mut self, reader: R, ) -> Result<(StreamStats, Option<Graph>)>

Process Turtle data from a reader.

Trait Implementations

impl Default for StreamingRdfLoader

fn default() -> Self

Returns the “default value” for a type.