Module tantivy_analysis_contrib::icu

Available on crate feature icu only.

This module contains all ICU-related components.

Structs

• ICUNormalizer2TokenFilter
  TokenFilter that converts text into a normal form. It supports all Google’s unicode normalization using Mode:
• ICUTokenizer
  ICU Tokenizer. It does not (yet ?) work as Lucene’s counterpart. Getting a tokenizer is simple :
• ICUTransformTokenFilter
  This TokenFilter allow to transform text into another, for example, to performe transliteration. See ICU documentation

Enums

• Direction
  Direction
• Error
  Represents a Unicode error, resulting from operations of low-level ICU libraries.
• Mode
  Normalization algorithms (see Wikipedia).