Crate lindera_dictionary_builder

Crate lindera_dictionary_builder 

Source
Expand description

This library is used to build custom lindera dictionary files.

Normally, you don’t need to use this library. Instead, use one of the pre-built dictionaries (e.g. ipadic, unidic, …) by enabling a feature flag for the lindera-tokenizer crate.

Re-exports§

pub use chardef::CharDefBuilderOptions;
pub use cost_matrix::CostMatrixBuilderOptions;
pub use dict::DictBuilderOptions;
pub use unk::UnkBuilderOptions;
pub use user_dict::build_user_dictionary;
pub use user_dict::UserDictBuilderOptions;

Modules§

chardef
cost_matrix
dict
unk
user_dict
utils