onpair 0.2.0

Short-strings compression for fast random access
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88

# Changelog

All notable changes to this project will be documented in this file.

The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [Unreleased](https://github.com/spiraldb/onpair/compare/v0.1.1...HEAD)

### Added

- Make `CompactDictionary` storage-backed, allowing validated dictionary bytes
  and offsets to be borrowed or shared without copying.
- Separate dictionary safety validation from correctness validation, allowing
  bounded decoding and tokenization checks without requiring full semantic
  validation.

### Removed

- Remove the obsolete cross-implementation benchmark harness and standalone
  TPC-H example, retaining the Rust benchmarks under `benches/`.

### Fixed

- Ensure the Rust setup action installs the pinned toolchain without referring to a nonexistent cache step.

## [0.1.1](https://github.com/spiraldb/onpair/compare/v0.1.0...v0.1.1) - 2026-07-15

### Fixed

- Reject compact dictionaries containing more than 65,536 tokens, which cannot
  be addressed by the `u16` token type.
- Add regression coverage for the 65,536-token boundary and document the
  dictionary size limit in the invariants and interchange format.

## [0.1.0](https://github.com/spiraldb/onpair/compare/v0.0.4...v0.1.0) - 2026-07-06

### Added

- Add compressed-domain equality, prefix, and substring search APIs.
- Add `Column::into_raw` and `code_bits_for_num_tokens` for embedders that
  store OnPair buffers in their own layout.

### Changed

- Refactor the public API around modules, `Column`/`ColumnView`, and validated dictionary types.
- Rename the training dictionary-width knob to `MaxDictBits` / `Config::max_dict_bits`, making it explicit that it is a dictionary-size budget; runtime code width is derived from dictionary size via `CompactDictionary::code_bits`.
- Bump the crate to 0.1.0 for the breaking public API changes.

## [0.0.4](https://github.com/spiraldb/onpair/compare/v0.0.3...v0.0.4) - 2026-05-29

### Added

- add back code_offsets to compressor ([#15](https://github.com/spiraldb/onpair/pull/15))

### Other

- remove code boundaries ([#13](https://github.com/spiraldb/onpair/pull/13))

## [0.0.3](https://github.com/spiraldb/onpair/compare/v0.0.2...v0.0.3) - 2026-05-29

### Other

- fat-table layout with scalar copy and L2-indexed fallback ([#12](https://github.com/spiraldb/onpair/pull/12))
- Feat/decode fat table scalar ([#7](https://github.com/spiraldb/onpair/pull/7))
- update changelog ([#10](https://github.com/spiraldb/onpair/pull/10))

## [0.0.2](https://github.com/spiraldb/onpair/compare/v0.0.1...v0.0.2) - 2026-05-29

### Other

- automate releases with release-plz ([#8](https://github.com/spiraldb/onpair/pull/8))
- clean up benchmarks and decompression ([#6](https://github.com/spiraldb/onpair/pull/6))
- add benchmarks with onpair cpp ([#5](https://github.com/spiraldb/onpair/pull/5))
- refine the onpair public API

## [0.0.1] - 2026-05-29

### Added

- Initial pure-Rust port of the onpair short-strings compression codec ([#4](https://github.com/spiraldb/onpair/pull/4)).
- Benchmarks comparing against the onpair C++ reference implementation ([#5](https://github.com/spiraldb/onpair/pull/5)).
- TPC-H and ClickBench benchmark harnesses.
- CI workflow (build, fmt, clippy, test) and Codspeed benchmark workflow ([#1](https://github.com/spiraldb/onpair/pull/1)).

### Changed

- Cleaned up benchmarks and decompression path ([#6](https://github.com/spiraldb/onpair/pull/6)).