[][src]Crate generic_lexer

Structs

Lexer

A lexer splits a source string into tokens using the given MatcherFn

LexerInput
Token

A token with a kind (usually an enum representing distinct token types) and its source text

Traits

MatcherFn

A matcher fn matches a character (and and any following characters) and returns a T to indicate the kind of token (see Token)

Type Definitions

MatcherResult

The result returned from a MatcherFn