Struct conllu::token::TokenBuilder

pub struct TokenBuilder { /* fields omitted */ }

A builder for Tokens.

The Token type stores a CoNLL-U token. However, since this format permits a large number of fields, construction of a token can get tedious. This builder provides a fluent interface for creating Tokens.

Methods

impl TokenBuilder

pub fn new(form: impl Into<String>) -> TokenBuilder

Create a Token builder with all non-form fields set to absent.

pub fn form(self, form: impl Into<String>) -> TokenBuilder

Set the word form or punctuation symbol.

pub fn lemma(self, lemma: impl Into<String>) -> TokenBuilder

Set the lemma or stem of the word form.

pub fn upos(self, upos: impl Into<String>) -> TokenBuilder

Set the universal part-of-speech tag.

pub fn xpos(self, xpos: impl Into<String>) -> TokenBuilder

Set the language-specific part-of-speech tag.

pub fn features(self, features: Features) -> TokenBuilder

Set the syntactic and/or morphological features of the token.

pub fn misc(self, misc: Misc) -> TokenBuilder

Set miscellaneous token features.

Trait Implementations

impl From<Token> for TokenBuilder

fn from(token: Token) -> Self

Performs the conversion.

impl From<TokenBuilder> for Token

fn from(builder: TokenBuilder) -> Self

Performs the conversion.