LLKV Column Map

Work in Progress

Prototype B+Tree replacement with batch-only pager I/O for the LLKV toolkit.

This crate provides low-level columnar storage using Arrow format. It is used by llkv-table for table storage and accessed by llkv-runtime for data operations.

Features

Physical/Logical key separation (batched writes of many logical keys can consume far less physical keys than writing directly to storage keys).
Logical keys namespaced per field.
Supports variable and fixed width keys.
Supports variable and fixed width values.
Logical key and value segment pruning.
Scanning iterator which can iterate over key or value without maintaining a separate reverse index.
Supports scanning iterator pagination.
Parallel scan/filter paths honor the LLKV_MAX_THREADS environment variable to cap Rayon worker utilization when needed.
Configurable gather null-handling policies (preserve, error, or drop missing/null rows) for column-oriented consumers.
Graphviz (.dot) visualization generation (see examples/visualize.rs) for illustrative purposes and debugging.

Testing

Some large (expensive) tests are marked #[ignore] by default.

Quick Start

cargo test

Run everything (including ignored)

cargo test -- --include-ignored

License