
Barrique is a schema-based binary serialization format featuring compression, metadata and streaming. The format was designed for locally storing large (>8 MiB) long-term memory objects.
The format is capable of storing any data representable in a sequence of bytes, meaning a schema is required to interpret the bytes. Data stored in regions up to 64 KiB - 1 bytes of raw bytes, each region holds a header. The specification has two available formats: Stream and Frame. Frame is a wrapper for Stream featuring a metadata header and a magic number. Stream is a core structure the format declares representing a sequence of regions.
Implementation
Standard barrique implementation published as a Rust crate. The implementation features in-place initialization for decoding pipeline and #[derive(...)] macros,
an example of which showed below:
use ;
Visit Docs for more information.
Specification
Barrique serialization format specification declared here