tupa-lexer

Tokenizes TupaLang source code.

Usage

use tupa_lexer::lex_with_spans;

let tokens = lex_with_spans("fn main() {}")?;
println!("{} tokens", tokens.len());
# Ok::<(), tupa_lexer::LexerError>(())

Crate

• Source: tupalang
• License: Apache-2.0