token-dict-1.3.0
- token-dict 1.3.0
- Permalink
- Docs.rs crate page
- MIT
- 10 July 2026
- Links
- Repository
- crates.io
- Source
- Owners
- ghost_333689
- Rin1000010
- Dependencies
- ptrie ^0.7.2 normal
  serde ^1 normal optional
  serde_bytes ^0.11 normal optional
- Versions
- 88.1% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

All

token_dict1.3.0

Crate Items

Structs
Traits
Functions

List of all items

Structs

UTF8CharIter
dict::Detokenization
dict::DictIntoIter
dict::DictIter
dict::TokenDict
dict::Tokenization
token::Token
token::TokenIntoIter

Traits

Val

Functions

dict_to_file_lines
file_lines_to_dict