lindera-analysis-5.2.0
- lindera-analysis 5.2.0
- Docs.rs crate page
- MIT
- 14 August 2026
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- mosuka
- Dependencies
- anyhow ^1.0.104 normal
  daachorse ^4.0.0 normal
  kanaria ^0.2.0 normal
  lindera ^5.2.0 normal
  regex ^1.13.1 normal
  serde ^1.0.229 normal
  serde_json ^1.0.151 normal
  serde_yaml_ng ^0.10.0 normal
  unicode-blocks ^0.1.10 normal
  unicode-normalization ^0.1.25 normal
  unicode-segmentation ^1.13.3 normal
  criterion ^0.8.2 dev
  lindera-dictionary ^5.2.0 dev
  once_cell ^1.21.4 dev
  serde_json ^1.0.151 dev
- Versions
- 30.7% of the crate is documented
Go to latest version
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Skip to main content

Module tokenizer

lindera_analysis5.2.0

Module tokenizer

Module Items

Structs
Type Aliases

In crate lindera_analysis

lindera_analysis

Module tokenizer

Structs§

Tokenizer
TokenizerBuilder

Type Aliases§

TokenizerConfig