vibrato 0.5.2

Vibrato: viterbi-based accelerated tokenizer
Documentation
1
2
3
4
5
6
7
8
9
# vibrato/src/tests/resources

## Credits

`char.def` is copied from [mecab-ipadic v2.7.0](https://taku910.github.io/mecab/).

`lex.csv`, `matrix.def`, and `unk.def` are copied from `tests` in
[sudachi.rs](https://github.com/WorksApplications/sudachi.rs/tree/develop/sudachi/tests/resources).
We have appended the last two rows in `unk.def` from the original source.