tokenize_all

Function tokenize_all 

Source
pub fn tokenize_all<'a>(
    db: &'a dyn Database,
    _tracked: Tracked,
    text: Arc<str>,
) -> Deque<LexerTerminal<'a>>
Expand description

Tokenizes the entire text and returns a deque of terminals.