Skip to main content

Crate dgen_data

Crate dgen_data 

Source
Expand description

High-performance random data generation with controllable deduplication and compression

This library provides:

  • Xoshiro256++ RNG for high-speed data generation (5-15 GB/s per core)
  • Controllable deduplication ratios (1:1 to N:1)
  • Controllable compression ratios (1:1 to N:1)
  • NUMA-aware parallel generation (optional)
  • Zero-copy Python bindings via PyO3

Re-exports§

pub use generator::generate_data;
pub use generator::generate_data_simple;
pub use generator::DataGenerator;
pub use generator::GeneratorConfig;
pub use generator::NumaMode;
pub use numa::NumaNode;
pub use numa::NumaTopology;

Modules§

constants
generator
High-performance data generation with controllable deduplication and compression
numa
NUMA topology detection and CPU pinning