Redirection

lance-tokenizer-11.0.0
- lance-tokenizer 11.0.0
- Permalink
- Docs.rs crate page
- Apache-2.0
- 30 August 2026
- Links
- Repository
- crates.io
- Source
- Owners
- lance-community
- Dependencies
- frostem ^1.20260804.0 normal
  icu_segmenter ^2.2 normal
  jieba-rs ^0.10.0 normal optional
  lindera ^3.0.7 normal optional
  serde ^1 normal
  stop-words ^0.10.0 normal
  unicode-normalization ^0.1.25 normal
- Versions
- 38.18% of the crate is documented
Platform
- x86_64-unknown-linux-gnu
Feature flags

docs.rs

Rust

Redirecting to ../../lance_tokenizer/enum.Language.html...