Docs.rs
text-tokenizer-0.6.6
text-tokenizer 0.6.6
Permalink
Docs.rs crate page
MIT
Links
Homepage
Repository
crates.io
Source
Owners
merl-twin
Dependencies
lazy_static ^1.5
normal
text-parsing ^0.6
normal
unicode-properties ^0.1
normal
unicode-segmentation ^1.2
normal
Versions
0%
of the crate is documented
Platform
i686-pc-windows-msvc
i686-unknown-linux-gnu
x86_64-apple-darwin
x86_64-pc-windows-msvc
x86_64-unknown-linux-gnu
Feature flags
docs.rs
About docs.rs
Privacy policy
Rust
Rust website
The Book
Standard Library API Reference
Rust by Example
The Cargo Guide
Clippy Documentation
text_
tokenizer
0.6.6
All Items
Crate Items
Re-exports
Structs
Enums
Traits
Crate
text_tokenizer
Copy item path
Source
Re-exports
§
pub use emoji::
EMOJIMAP
;
Structs
§
EMOJIMAP
Text
Text
Locality
TextStr
Text
Token
Text
Tokens
Tokenizer
Params
Tokens
Unicode
Sentence
Breaker
Enums
§
Bound
Error
Formatter
Number
Numerical
Original
Error
Separator
Special
Struct
Token
Token2
Tokenizer
Options
Unicode
Word
Traits
§
Into
Tokenizer
Sentence
Breaker