pub enum TokenType {
Normal,
BOS,
UNK,
}
Token came from mecab dictionary.
Used internally for virtual beginning-of-string and end-of-string tokens.
Unknown character or characters. Could not be matched to a mecab dictionary entry at all.
Note: notmecab handles UNK tokens slightly differently from how mecab does.
This differnce in behavior is considered a bug.
Performs copy-assignment from
source
.
Read more
Formats the value using the given formatter.
Read more
This method tests for
self
and
other
values to be equal, and is used
by
==
.
Read more
This method tests for
!=
. The default implementation is almost always
sufficient, and should not be overridden without very good reason.
Read more
Immutably borrows from an owned value.
Read more
Mutably borrows from an owned value.
Read more
Returns the argument unchanged.
Calls U::from(self)
.
That is, this conversion is whatever the implementation of
From<T> for U
chooses to do.
The resulting type after obtaining ownership.
Creates owned data from borrowed data, usually by cloning.
Read more
Uses borrowed data to replace owned data, usually by cloning.
Read more
The type returned in the event of a conversion error.
Performs the conversion.
The type returned in the event of a conversion error.
Performs the conversion.