segmenter
v1.0.0
About
Segment Chinese sentences into component words using a dictionary-driven largest first matching approach.
Usage
extern crate chinese_segmenter;
use ;
let sentence = "今天晚上想吃羊肉吗?";
initialize; // Optional intialization to load data
let result: = tokenize;
println!; // --> ['今天', '晚上', '想', '吃', '羊肉', '吗']