morsels_lang_chinese-0.7.3
- morsels_lang_chinese 0.7.3
- Permalink
- Docs.rs crate page
- MIT
- Links
- Documentation
- Repository
- Crates.io
- Source
- Owners
- ang-zeyu
- Dependencies
- lazy_static ^1.4 normal
  morsels_common =0.7.3 normal
  morsels_lang_ascii =0.7.3 normal
  regex ^1 normal
  smartstring ^0.2.7 normal
- Versions
Platform
Feature flags

Rust

In morsels_lang_chinese::chinese

Function morsels_lang_chinese::chinese::new_with_options

source · [−]

pub fn new_with_options(lang_config: &MorselsLanguageConfig) -> Tokenizer