Struct KTokenStream

pub struct KTokenStream { /* private fields */ }

Convinient way to manage any kind of tokens stream by exposing basic function to advance and consume the stream.

Heavenly inspired to albert_stream https://github.com/vincenzopalazzo/albert/tree/main/stream

Implementations

impl KTokenStream

pub fn new(tokens: &TokenStream) -> Self

create a new instance from a TokenStream

pub fn new_with_pos(tokens: &TokenStream, pos: usize) -> Self

create the a new instance from a TokenStream and the initial position

pub fn advance(&mut self) -> TokenTree

advance the position and return the previous element in position - 1

pub fn lookup(&self, step: usize) -> &TokenTree

perform a search operation inside the stream by a number of specified steps.

pub fn has(&self, step: usize) -> bool

perform a search operation inside the stream by a number of specified steps.

pub fn next(&mut self)

advance the position of the stream.

pub fn prev(&self) -> &TokenTree

take the previous element of the stream from the current position.

pub fn peek(&self) -> &TokenTree

return he token at the current position.

pub fn last(&self) -> &TokenTree

return the last token of the stream.

pub fn match_tok(&self, tok: &str) -> bool

match the current token with the one specified.

pub fn is_end(&self) -> bool

check if it is reach the end of the stream

pub fn to_ktoken_stream(&self) -> KTokenStream

unwrap the TokenTree::Group and the return the token stream that contains. If the current token it is not a TokenTree::Group the function will panic

pub fn opt_ktoken_stream(&self) -> Option<KTokenStream>

unwrap the TokenTree::Group and the return the token stream that contains. If the current token it is not a TokenTree::Group the function will panic

pub fn unwrap_group(&self) -> TokenTree

pub fn unwrap_group_as_stream(&self) -> TokenStream

pub fn is_group(&self) -> bool

check if the current token is a TokenTree::Group

pub fn consume_brace(&mut self)

Trait Implementations

impl Debug for KTokenStream

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<&TokenStream> for KTokenStream

fn from(value: &TokenStream) -> Self

Converts to this type from the input type.

impl From<TokenStream> for KTokenStream

fn from(value: TokenStream) -> Self

Converts to this type from the input type.