pub fn lex(source: &str, media_type: MediaType) -> Vec<LexedItem>ⓘNotable traits for Vec<u8, A>impl<A> Write for Vec<u8, A> where
A: Allocator, Expand description
Given the source text and media type, tokenizes the provided text to a collection of tokens and comments.