summayvy-tokenizer-api 0.1.0

Tokenizer API of summavy
Documentation
  • Coverage
  • 82.61%
    19 out of 23 items documented0 out of 17 items with examples
  • Size
  • Source code size: 8.02 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 2.36 MB This is the summed size of all files generated by rustdoc for all configured targets
  • Links
  • crates.io
  • Dependencies
  • Versions
  • Owners
  • ppodolsky

#Tokenizer-API

An API to interface a tokenizer with tantivy.

The API will be kept stable in order to not break support for existing tokenizers.