vibrato 0.5.2

Vibrato: viterbi-based accelerated tokenizer
Documentation
1
2
3
4
DEFAULT,0,0,0,補助記号,一般,*,*
ALPHA,0,0,0,名詞,普通名詞,一般,*
KANJI,0,0,0,名詞,普通名詞,一般,*
KANJINUMERIC,0,0,0,名詞,数,*,*