Enum SegmentLanguage 

pub enum SegmentLanguage {
    Chinese,
    Japanese,
    Korean,
}

The language a Tokenizer::Segment segments with.

Separate from crate::language::Language, which selects a Snowball stemming algorithm: the two vocabularies do not overlap. Snowball strips suffixes and has no CJK algorithms, while these languages are segmented by dictionary-driven morphological analysis and have no stemmer. Keeping them apart makes SNOWBALL(KOREAN) and SEGMENT(ENGLISH) unrepresentable rather than merely rejected.

Variants

Chinese

Japanese

Korean

Implementations

impl SegmentLanguage

pub fn as_str(self) -> &'static str

Trait Implementations

impl Clone for SegmentLanguage

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SegmentLanguage

impl Debug for SegmentLanguage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for SegmentLanguage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for SegmentLanguage

impl Hash for SegmentLanguage

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for SegmentLanguage

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SegmentLanguage

impl ToSql for SegmentLanguage

fn fmt_sql(&self, f: &mut String, _fmt: SqlFormat)

Format the type to a SQL string.

fn to_sql(&self) -> String

Convert the type to a SQL string.

fn to_sql_pretty(&self) -> String

Convert the type to a pretty-printed SQL string with indentation.