ik-rs

ik-analyzer for Rust

support Tantivy

Usage

Chinese Segment

    let mut ik = IKSegmenter::new();
    let text = "中华人民共和国";
    let tokens = ik.tokenize(text, TokenMode::SEARCH); // TokenMode::INDEX
    for token in tokens {
        println!("{:?}", token);
    }

Usage for Tantivy

todo