[][src]Crate generic_lexer

Structs

BufferedInput
Lexer

A lexer splits a source string into tokens using the given MatcherFn

Token

A token with a kind (usually an enum representing distinct token types) and its source text

Enums

MatchError

Traits

Matcher

A matcher fn matches a character (and and any following characters) and returns a T to indicate the kind of token (see Token)

Type Definitions

MatchResult