chinese_segmenter 1.0.1

Tokenize Chinese sentences using a dictionary-driven largest first matching approach.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24

# segmenter
##### v1.0.0
---

### About
Segment Chinese sentences into component words using a dictionary-driven largest first matching approach.

### Usage
```rust
extern crate chinese_segmenter;

use chinese_segmenter::{initialize, tokenize};

let sentence = "今天晚上想吃羊肉吗？";
initialize(); // Optional intialization to load data
let result: Vec<&str> = tokenize(sentence);
println!("{:?}", result); // --> ['今天', '晚上', '想', '吃', '羊肉', '吗']
```

### Contributors
- [Preston Wang-Stosur-Bassett](http://stosur.info)

### License
[MIT](https://github.com/sotch-pr35mac/segmenter/blob/master/LICENSE)