[−][src]Crate generic_lexer

Structs

Lexer	A lexer splits a source string into tokens using the given `MatcherFn`
LexerInput
Token	A token with a kind (usually an enum representing distinct token types) and its source text

A matcher fn matches a character (and and any following characters) and returns a T to indicate the kind of token (see Token)

The result returned from a MatcherFn