Expand description
Vectorized Batch Processing
High-performance batch operations using SIMD and cache-optimized algorithms:
- SIMD CRC32: Hardware-accelerated checksums
- Vectorized Compression: Parallel compression/decompression
- Batch Message Encoding: Encode multiple messages in single pass
- Prefetching: Predictive data loading
- Cache-Oblivious Algorithms: Optimal for any cache size
Performance characteristics:
- 4-8x faster checksums with SSE4.2/AVX2
- 2-4x faster batch encoding vs sequential
- Near-zero allocation hot path
Structs§
- Batch
Decoder - Batch decoder for high-throughput message decoding
- Batch
Encoder - Batch encoder for high-throughput message encoding
- Batch
Message - Message for batch encoding
- Batch
Processor - Batch processor for parallel operations
- Decoded
Message - Decoded message
- Decoder
Stats Snapshot - Encoder
Stats Snapshot - Processor
Stats Snapshot - Record
Batch - Record batch for columnar storage/processing
- Record
Batch Iter - Iterator over RecordBatch
Functions§
- crc32_
batch - Batch CRC32 calculation for multiple buffers
- crc32_
fast - Fast CRC32 calculation using hardware acceleration when available
- memchr_
fast - Vectorized memory search
- memcmp_
fast - Vectorized memory comparison
- memmem_
fast - Vectorized pattern search