Module storage_optimizations 

Storage optimizations for vector indices

This module provides optimized storage formats for efficient vector serialization:

• Binary formats for fast I/O
• Compression with multiple algorithms
• Streaming I/O for large datasets
• Memory-mapped file support

Structs

MmapVectorFile

Memory-mapped vector file for efficient random access

StorageConfig

Binary storage format configuration

StorageUtils

Utility functions for storage operations

VectorBlock

Vector block for chunked storage

VectorFileHeader

Binary file header for vector storage

VectorReader

Streaming vector reader for large datasets

VectorWriter

Streaming vector writer for large datasets

Enums

CompressionType

Compression methods for vector storage

Functions

compress_bytes

Compress raw bytes with the given algorithm via OxiARC’s Pure Rust compression crates (COOLJAPAN compression policy: oxiarc-* only, never flate2/zstd/zip/lz4/brotli/snap/tar from crates.io).

decompress_bytes

Decompress bytes previously produced by compress_bytes with the same compression algorithm.