Docs.rs
sqz-engine-1.1.1
sqz-engine 1.1.1
Permalink
Docs.rs crate page
Links
Homepage
Repository
crates.io
Source
Owners
ojuschugh1
Dependencies
chrono ^0.4
normal
dirs-next ^2.0
normal
notify ^6
normal
rusqlite ^0.31
normal
serde ^1
normal
serde_json ^1
normal
sha2 ^0.10
normal
tempfile ^3
normal
thiserror ^1
normal
tiktoken-rs ^0.6
normal
toml ^0.8
normal
toml_edit ^0.22
normal
tree-sitter ^0.22
normal
tree-sitter-bash ^0.21
normal
tree-sitter-javascript ^0.21
normal
tree-sitter-python ^0.21
normal
tree-sitter-rust ^0.21
normal
proptest ^1
dev
Versions
69.46%
of the crate is documented
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
Skip to main content
Module bpe_compressor
sqz_
engine
1.1.1
Module bpe_
compressor
Module Items
Structs
Functions
In crate sqz_
engine
sqz_engine
Module
bpe_
compressor
Copy item path
Source
Structs
§
BpeConfig
Configuration for BPE compression.
BpeResult
Result of BPE compression.
Merge
Rule
A single BPE merge rule.
Functions
§
bpe_
compress
Compress text using byte-pair encoding at the word level.