Docs.rs
bpe-openai-0.2.1
bpe-openai 0.2.1
Docs.rs crate page
MIT
Links
Repository
crates.io
Source
Owners
hendrikvanantwerpen
gorzell
aneubeck
Dependencies
bpe ^0.2.0
normal
either ^1.13
normal
regex-automata ^0.4
normal
rmp-serde ^1
normal
bpe ^0.2.0
dev
tiktoken-rs ^0.6
dev
base64 ^0.22.1
build
bpe ^0.2.0
build
flate2 ^1.0
build
rmp-serde ^1
build
serde ^1
build
Versions
73.33%
of the crate is documented
Go to latest version
Platform
i686-pc-windows-msvc
i686-unknown-linux-gnu
x86_64-apple-darwin
x86_64-pc-windows-msvc
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
bpe_
openai
0.2.1
Module byte_
pair_
encoding
Module Items
Structs
In crate bpe_
openai
bpe_openai
Module
byte_pair_encoding
Copy item path
Source
Structs
ยง
Byte
Pair
Encoding
Representation of the byte pair dictionary. This struct provides various conversions. We put all of them into a single struct so that they can be reused by different implementations.