tokenx-0.2.0
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

tokenx 0.2.0

vocab-free heuristic LLM token-count estimation

Crate
Source
Builds
Feature flags

src
tests
.cargo_vcs_info.json
.gitignore
Cargo.lock
Cargo.toml
Cargo.toml.orig
CHANGELOG.md
LICENSE
README.md

/target
Cargo.lock
**/*.rs.bk
*.md
!README.md
!CHANGELOG.md
*token*