Crate generic_lexer

Source

Structs§

BufferedInput
Lexer
A lexer splits a source string into tokens using the given MatcherFn
Token
A token with a kind (usually an enum representing distinct token types) and its source text

Enums§

MatchError

Traits§

Matcher
A matcher fn matches a character (and and any following characters) and returns a T to indicate the kind of token (see Token)

Type Aliases§

MatchResult