Struct TokenBuilder

pub struct TokenBuilder { /* private fields */ }

A builder for Tokens.

The Token type stores a CoNLL-U token. However, since this format permits a large number of fields, construction of a token can get tedious. This builder provides a fluent interface for creating Token instances.

Implementations

impl TokenBuilder

pub fn new(form: impl Into<String>) -> TokenBuilder

Create a TokenBuilder with all non-form fields set to absent.

pub fn form(self, form: impl Into<String>) -> TokenBuilder

Set the word form or punctuation symbol.

pub fn lemma(self, lemma: impl Into<String>) -> TokenBuilder

Set the lemma or stem of the word form.

pub fn upos(self, upos: impl Into<String>) -> TokenBuilder

Set the universal part-of-speech tag.

pub fn xpos(self, xpos: impl Into<String>) -> TokenBuilder

Set the language-specific part-of-speech tag.

pub fn features(self, features: Features) -> TokenBuilder

Set the syntactic and/or morphological features of the token.

pub fn deps(self, deps: impl Into<String>) -> TokenBuilder

Set UD enhanced dependencies.

Warning: this method will be removed once proper support for enhanced dependencies is added.

pub fn misc(self, misc: Misc) -> TokenBuilder

Set miscellaneous token features.

Trait Implementations

impl From<Token> for TokenBuilder

fn from(token: Token) -> Self

Converts to this type from the input type.

impl From<TokenBuilder> for Token

fn from(builder: TokenBuilder) -> Self

Converts to this type from the input type.