snowball_stemmers_rs

Snowball_stemmers_rs implements the stemmer algorithms from the snowball project which are compiled to Rust using the rust-backend of the snowball compiler.

Supported Languages/Algorithms

Arabic
Armenian
Basque
Catalan
Czech
Danish
Dutch
DutchPorter
English
Esperanto
Estonian
Finnish
French
German
Greek
Hindi
Hungarian
Indonesian
Irish
Italian
Lithuanian
Lovins
Nepali
Norwegian
Persian
Polish
Porter
Portuguese
Romanian
Russian
Serbian
Sesotho
Spanish
Swedish
Tamil
Turkish
Ukrainian
Yiddish

Usage

extern crate snowball_stemmers_rs;
use snowball_stemmers_rs::{Algorithm, Stemmer};

// Create a stemmer for the english language
let en_stemmer = Stemmer::create(Algorithm::English);

// Stem the word "fishing"
// All algorithms expect their input in lowercase.
assert_eq!(en_stemmer.stem("fishing"), "fish");

Add an additional Language

To create an additional stemmer language for Rust from the official Snowball repository, you must use the Snowball compiler (snowball) to translate the language algorithm definition into Rust source code.

Build the Snowball Compiler

The Snowball compiler is written in ISO C. You first need to build it to generate the executable that performs the translation.

Clone the repository: git clone https://github.com/snowballstem/snowball.git

Compile the compiler: Navigate to the root and run make. This produces the snowball executable.

Generate Rust Code for the additional stemmer language

The algorithm definition is located at algorithms/additional_language.sbl. Use the compiler with the -rust flag to generate the Rust implementation.