tantivy-tokenizer-tiny-segmenter ================================ A Japanese tokenizer based on [TinySegmenter](http://chasen.org/~taku/software/TinySegmenter/). See examples/basic.rs for basic usage.