Expand description
High-throughput batch processing pipeline
This module provides an optimized batch processing system that combines:
- SIMD-accelerated JSON parsing for fast deserialization
- Lock-free sharded queues for parallel ingestion
- Memory pooling for zero-allocation hot paths
§Performance Target
- 1M+ events/sec sustained throughput
- Sub-millisecond p99 latency
- Linear scalability with CPU cores
Structs§
- Arena
Batch Buffer - Arena-backed batch buffer for zero-allocation processing
- Batch
Processor - High-throughput batch event processor
- Batch
Processor Config - Configuration for batch processor
- Batch
Processor Stats - Statistics for batch processing
- Batch
Result - Result of batch processing operation
- RawEvent
Data - Raw event data for batch parsing