Docs.rs
tokenfold-core-0.3.2
tokenfold-core 0.3.2
Permalink
Docs.rs crate page
Apache-2.0
18 July 2026
Links
Repository
crates.io
Source
Owners
snchimata
Dependencies
regex ^1
normal
serde ^1
normal
serde_json ^1
normal
sha2 ^0.10
normal
thiserror ^1
normal
tiktoken-rs ^0.7
normal
optional
toml ^0.8
normal
proptest ^1
dev
Versions
23.02%
of the crate is documented
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
Skip to main content
Module token_estimator
tokenfold_
core
0.3.2
Module token_
estimator
Module Items
Structs
Traits
In crate tokenfold_
core
tokenfold_core
Module
token_
estimator
Copy item path
Source
Structs
§
Byte
Heuristic
Estimator
Fast pre-filter ONLY; under-counts dense JSON/code. Never used to claim exact savings.
Tiktoken
Estimator
Traits
§
Token
Estimator