tantivy-meta-tokenizer-0.3.0
- tantivy-meta-tokenizer 0.3.0
- Docs.rs crate page
- BSD-3-Clause
- Links
- Homepage
- Repository
- crates.io
- Source
- Owners
- zu1k
- Dependencies
- fast2s ^0.3 normal
  itertools ^0.10 normal
  jieba-rs ^0.6 normal
  lazy_static ^1.4 normal
  pinyin ^0.9 normal
  tantivy ^0.19 normal
- Versions
- 12.5% of the crate is documented
Platform
Feature flags

Rust

In tantivy_meta_tokenizer

Function tantivy_meta_tokenizer::get_tokenizer

pub fn get_tokenizer() -> TextAnalyzer