Skip to main content

Module streaming

oxirs_chat::memory_optimization

Module streaming 

Source
Expand description

Streaming processing for large datasets

Structsยง

ChunkProcessor
Chunk processor for embeddings
StreamProcessor
Stream processor for memory-efficient data processing
StreamingAggregator
Streaming aggregator for reducing memory footprint