Enum TokenID

pub enum TokenID {
    Single(usize),
    Range(usize, usize),
    Empty(usize, usize),
}

The id of a Token.

Variants

Single(usize)

The standard, single index.

Range(usize, usize)

A range of tokens that form an ID. Denoted by a hyphen in CoNLL-U format (e.g. 1-3).

Empty(usize, usize)

To represent ellipses, ConLL-U allows to create sub-indices of the preceding regular node (or 0 if it is a the beginning of a sentence). They are separated by a decimal point and represent an “empty” node.

Trait Implementations

impl Clone for TokenID

fn clone(&self) -> TokenID

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenID

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for TokenID

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for TokenID

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for TokenID

fn eq(&self, other: &TokenID) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TokenID

impl Eq for TokenID

impl StructuralPartialEq for TokenID