Struct LexOptions 

pub struct LexOptions {
    pub by: Option<String>,
    pub default: Option<Language>,
    pub stop_words: bool,
    pub segmenter: Segmenter,
    pub stem: StemMode,
    pub variants: bool,
    pub fold: bool,
    pub max_token_length: usize,
    pub han: HanForm,
    pub cjk: CjkMode,
}

Options of a LexTokenizer; the parsed and rendered form of a lex(...) spec. Only values that differ from the defaults are rendered.

Fields

by: Option<String>

Field whose text values supply the language hint; None = no per-document language, hints are ignored, default always applies.

default: Option<Language>

Language applied when no hint is present; None = no stemming or stop list.

stop_words: bool

Drop the routed language’s stop words (positions keep their gaps).

segmenter: Segmenter

stem: StemMode

variants: bool

Keep the written word as the token and index stems and folded forms as same-position variants.

fold: bool

Fold diacritics of Latin, Cyrillic and Greek tokens.

max_token_length: usize

Drop tokens longer than this many characters (0 = unlimited).

han: HanForm

cjk: CjkMode

Implementations

impl LexOptions

pub fn parse(params: &str) -> Result<Self, String>

Parse the key: value, ... body of a lex(...) spec.

Trait Implementations

impl Clone for LexOptions

fn clone(&self) -> LexOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LexOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LexOptions

fn default() -> Self

Returns the “default value” for a type.

impl Display for LexOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for LexOptions

impl PartialEq for LexOptions

fn eq(&self, other: &LexOptions) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for LexOptions