lib.rs - source

lindera-tokenizer-0.27.1
- lindera-tokenizer 0.27.1
- Docs.rs crate page
- MIT
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- mosuka
- Dependencies
- bincode ^1.3.3 normal
  byteorder ^1.4.3 normal
  lindera-core ^0.27.1 normal
  lindera-dictionary ^0.27.1 normal
  once_cell ^1.18.0 normal
  serde ^1.0.167 normal
  serde_json ^1.0.100 normal
  criterion ^0.5.1 dev
  once_cell ^1.18.0 dev
- Versions
- 66.67% of the crate is documented
Go to latest version
Platform
Feature flags

docs.rs

Rust

1
2

pub mod token;
pub mod tokenizer;