vibrato 0.5.2

Vibrato: viterbi-based accelerated tokenizer
Documentation 
1
2
3
4

DEFAULT,7,7,3857,補助記号,一般,*,*,*,*
ALPHA,7,7,11633,名詞,普通名詞,一般,*,*,*
KANJI,7,7,14657,名詞,普通名詞,一般,*,*,*
KANJINUMERIC,7,7,27473,名詞,数,*,*,*,*,*