Trait Tokenizable 

pub trait Tokenizable {
    // Required method
    fn tokenize(&self) -> Result<Vec<Token<'_>>, TokenError>;
}

A datatype that can be tokenized

Required Methods

fn tokenize(&self) -> Result<Vec<Token<'_>>, TokenError>

Tokenize to a token stream

Dyn Compatibility

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors

impl<STR> Tokenizable for STR

where STR: AsRef<str>,