Struct conllx::Token [] [src]

pub struct Token { /* fields omitted */ }

A token with the CoNLL-X annotation layers.

The fields of CoNLLX tokens are described at:

http://ilk.uvt.nl/conll/

This type provides exactly the same fields, except for the ID field (since it can be derived from the sentence position of the token). If a particular field is absent (_ in the CoNLL-X format), its value is None.

Methods

impl Token
[src]

[src]

Create a new token where all the non-form fields are absent.

[src]

Get the word form or punctuation symbol.

[src]

Get the lemma or stem of the word form.

[src]

Get the coarse-grained part-of-speech tag.

[src]

Get the fine-grained part-of-speech tag.

[src]

Get the syntactic and/or morphological features of the token.

[src]

Get the head of the token. This is the sentence position of the head plus one. If the head is 0, the token the root of the dependency tree.

[src]

Get the dependency relation to the head of this token.

[src]

Get the projective head of the token. This is the sentence position of the head plus one. If the head is 0, the token the root of the dependency tree. The dependency structure resulting from the projective heads must be projective.

[src]

Get the dependency relation to the projective head of this token.

[src]

Set the word form or punctuation symbol.

[src]

Set the lemma or stem of the word form.

[src]

Set the coarse-grained part-of-speech tag.

[src]

Set the fine-grained part-of-speech tag.

[src]

Set the syntactic and/or morphological features of the token.

[src]

Set the head of the token. This is the sentence position of the head plus one. If the head is 0, the token the root of the dependency tree.

[src]

Set the dependency relation to the head of this token.

[src]

Set the projective head of the token. This is the sentence position of the head plus one. If the head is 0, the token the root of the dependency tree. The dependency structure resulting from the projective heads must be projective.

[src]

Set the dependency relation to the projective head of this token.

Trait Implementations

impl Clone for Token
[src]

[src]

Returns a copy of the value. Read more

1.0.0
[src]

Performs copy-assignment from source. Read more

impl Debug for Token
[src]

[src]

Formats the value using the given formatter.

impl Eq for Token
[src]

impl PartialEq for Token
[src]

[src]

This method tests for self and other values to be equal, and is used by ==. Read more

[src]

This method tests for !=.

impl Display for Token
[src]

[src]

Formats the value using the given formatter. Read more

impl From<TokenBuilder> for Token
[src]

[src]

Performs the conversion.