Struct Tokens 

pub struct Tokens<'a> { /* private fields */ }

The tokens that the parser reads.

Implementations

impl<'a> Tokens<'a>

pub fn new(text: &'a str) -> Tokens<'a>

The tokens of text.

pub fn take_notices(&mut self) -> Vec<Notice>

Takes the notices that the tokens until now gave.

pub fn next_token(&mut self) -> Result<Token<'a>, Error>

The next token. After the last token it gives the end, token 0, again and again.

Trait Implementations

impl<'a> Debug for Tokens<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.