Function angelmarkup::lex

source · [−]

pub fn lex(source_code: String) -> Vec<Token>ⓘNotable traits for Vec<u8, A>impl<A> Write for Vec<u8, A> where
    A: Allocator,

Expand description

The actual lexing function: Iterates through all lines and then through all characters and builds a vector of tokens while doing so and finally returns this vector.