Module finalfusion::subword

Utilities for subword units.

Structs

• ExplicitIndexer
  Indexer for explicitly stored NGrams.
• HashIndexer
  Indexer using a hash function.
• NGrams
  Iterator over n-grams in a sequence.
• NGramsIndicesIter
  Iterator over the n-grams in a word and the corresponding subword indices.
• StrWithCharLen
  A string reference with its length in characters.

Enums

• IndicesScope
  What to compute subwords for.

Traits

• BucketIndexer
  N-Gram indexer with bucketing.
• Indexer
  N-Gram indexer
• SubwordIndices
  Trait returning iterators over subwords and indices.

Type Aliases

• FinalfusionHashIndexer
  Standard hash-based indexer in finalfusion.
• NGramVec