Docs.rs
tiktoken-rust-0.2.1
Platform
i686-pc-windows-msvc
x86_64-apple-darwin
x86_64-pc-windows-msvc
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
tiktoken-rust 0.2.1
a fast BPE tokeniser for use with OpenAI's models
Crate
Source
Builds
Feature flags
Documentation
.github
scripts
src
tests
.cargo_vcs_info.json
.gitignore
Cargo.lock
Cargo.toml
Cargo.toml.orig
LICENSE
MANIFEST.in
pyproject.toml
README.md
rustfmt.toml