Struct Tokenizer 

pub struct Tokenizer<'a> { /* private fields */ }

CSS tokenizer.

Implementations

impl<'a> Tokenizer<'a>

pub fn new(text: &str) -> Tokenizer<'_>

Constructs a new Tokenizer.

pub fn new_bound(text: &str, start: usize, end: usize) -> Tokenizer<'_>

Constructs a new bounded Tokenizer.

It can be useful if CSS data is inside other data, like HTML. Using this method you will get an absolute error positions and not relative, like when using new().

pub fn pos(&self) -> usize

Returns a current position in the text.

pub fn parse_next(&mut self) -> Result<Token<'a>, Error>

Parses a next token.