Enum erl_tokenize::HiddenToken

pub enum HiddenToken {
    Comment(CommentToken),
    Whitespace(WhitespaceToken),
}

Hidden token.

“Hidden” means it has no lexical meanings.

Variants

Comment(CommentToken)

Tuple Fields

0: CommentToken

Whitespace(WhitespaceToken)

Tuple Fields

0: WhitespaceToken

Implementations

impl HiddenToken

pub fn text(&self) -> &str

Returns the original textual representation of this token.

pub fn as_comment_token(&self) -> Option<&CommentToken>

Tries to return the reference to the inner CommentToken.

pub fn as_whitespace_token(&self) -> Option<&WhitespaceToken>

Tries to return the reference to the inner WhitespaceToken.

pub fn into_comment_token(self) -> Result<CommentToken, Self>

Tries to return the inner CommentToken.

pub fn into_whitespace_token(self) -> Result<WhitespaceToken, Self>

Tries to return the inner WhitespaceToken.

Trait Implementations

impl Clone for HiddenToken

fn clone(&self) -> HiddenToken

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for HiddenToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for HiddenToken

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<CommentToken> for HiddenToken

fn from(f: CommentToken) -> Self

Performs the conversion.

impl From<HiddenToken> for Token

fn from(f: HiddenToken) -> Self

Performs the conversion.

impl From<WhitespaceToken> for HiddenToken

fn from(f: WhitespaceToken) -> Self

Performs the conversion.

impl PositionRange for HiddenToken

fn start_position(&self) -> Position

Returns the (inclusive) start position of this.

fn end_position(&self) -> Position

Returns the (exclusive) end position of this.