vibrato 0.5.1

Vibrato: viterbi-based accelerated tokenizer
Documentation

vibrato

Vibrato is a fast implementation of tokenization (or morphological analysis) based on the Viterbi algorithm.

API documentation

https://docs.rs/vibrato

License

Licensed under either of

at your option.

Contribution

Unless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.