Skip to main content

Module vectorized

Module vectorized 

Source
Expand description

Vectorized Batch Processing

High-performance batch operations using SIMD and cache-optimized algorithms:

  • SIMD CRC32: Hardware-accelerated checksums
  • Vectorized Compression: Parallel compression/decompression
  • Batch Message Encoding: Encode multiple messages in single pass
  • Prefetching: Predictive data loading
  • Cache-Oblivious Algorithms: Optimal for any cache size

Performance characteristics:

  • 4-8x faster checksums with SSE4.2/AVX2
  • 2-4x faster batch encoding vs sequential
  • Near-zero allocation hot path

Structs§

BatchDecoder
Batch decoder for high-throughput message decoding
BatchEncoder
Batch encoder for high-throughput message encoding
BatchMessage
Message for batch encoding
BatchProcessor
Batch processor for parallel operations
DecodedMessage
Decoded message
DecoderStatsSnapshot
EncoderStatsSnapshot
ProcessorStatsSnapshot
RecordBatch
Record batch for columnar storage/processing
RecordBatchIter
Iterator over RecordBatch

Functions§

crc32_batch
Batch CRC32 calculation for multiple buffers
crc32_fast
Fast CRC32 calculation using hardware acceleration when available
memchr_fast
Vectorized memory search
memcmp_fast
Vectorized memory comparison
memmem_fast
Vectorized pattern search