kham-core 0.1.0

Pure Rust Thai word segmentation engine — no_std compatible
Documentation

kham-core

Pure Rust Thai word segmentation engine. no_std compatible (requires alloc).

Quick start

use kham_core::Tokenizer;

let tokenizer = Tokenizer::new();
let tokens = tokenizer.segment("กินข้าวกับปลา");
for token in &tokens {
    println!("{} ({:?})", token.text, token.kind);
}