Struct lib_ruby_parser::Token [−][src]
#[repr(C)]pub struct Token { /* fields omitted */ }
Expand description
A token that is emitted by a lexer and consumed by a parser
Trait Implementations
Constructor
Returns type of the token
Returns value of the token
Sets token value
Consumes self, returns owned values of the token
Returns lex state before reading the token
Returns lex state after reading the token
Consumes a token and returns an owned byte array of the token value
Converts token value into &str
Converts token to a string, replaces unknown chars to U+FFFD
Converts token to a string
Consumes a token and converts it into a string
Returns name of the token
Auto Trait Implementations
impl RefUnwindSafe for Token
impl UnwindSafe for Token
Blanket Implementations
Mutably borrows from an owned value. Read more