Docs.rs
token-count-0.4.0
token-count 0.4.0
Docs.rs crate page
MIT
Links
Homepage
Repository
crates.io
Source
Owners
shaunburdick
Dependencies
anyhow ^1.0.102
normal
clap ^4.6
normal
gemini-tokenizer ^0.2.0
normal
reqwest ^0.12
normal
serde ^1.0.149
normal
serde_json ^1.0.149
normal
strsim ^0.11
normal
thiserror ^1.0
normal
tiktoken-rs ^0.9.1
normal
tokio ^1
normal
assert_cmd ^2.0
dev
criterion ^0.5
dev
mockito ^1.0
dev
predicates ^3.0
dev
tempfile ^3.0
dev
Versions
79.28%
of the crate is documented
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
Skip to main content
Module debug
token_
count
0.4.0
Module debug
Module Items
Structs
In token_
count::
output
token_count
::
output
Module
debug
Copy item path
Source
Expand description
Debug formatter - outputs token IDs and sample decoded tokens
Structs
ยง
Debug
Formatter
Debug formatter that outputs token IDs and sample decoded tokens