Docs.rs
tokeneer-0.1.0
Platform
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Badges
Builds
Metadata
Shorthand URLs
Download
Rustdoc JSON
Build queue
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
tokeneer 0.1.0
Another tokenizer crate
Crate
Source
Builds
Feature flags
Documentation
Coverage
9.09%
1
out of
11
items documented
0
out of
6
items with examples
Size
Source code size: 40.12 kB
This is the summed size of all the files inside the crates.io package for this release.
Documentation size: 587.34 kB
This is the summed size of all files generated by rustdoc for all configured targets
Ø build duration
this release: 19s
Average build duration of
successful
builds.
all releases: 20s
Average build duration of
successful
builds in releases after 2024-10-23.
Links
InfiniTensor/tokeneer
1
4
0
crates.io
Dependencies
memchr ^2.7
normal
patricia_tree ^0.9
normal
regex ^1.11
normal
Versions
0.1.0
(2025-02-23)
0.0.2
(2024-09-19)
0.0.1
(2024-08-11)
0.0.0
(2024-08-07)
Owners
Tokeneer
Another tokenizer crate.
