ingestion_stack

Function ingestion_stack 

Source
pub fn ingestion_stack(
    path: PathBuf,
) -> Result<MetricsBlockStore<DedupBlockStore<BloomBlockStore<CachedBlockStore<SledBlockStore>>>>>
Expand description

Create a high-throughput ingestion stack

Optimized for maximum write throughput:

  • Deduplication for storage efficiency
  • Smaller cache (200MB) to favor writes
  • Bloom filter for fast existence checks
  • Metrics for monitoring

Best for: Data ingestion pipelines, ETL processes, bulk imports