Module rivet::lexer [] [src]

Structs

Tokens

Enums

Token
TokenError

Functions

lex
tokenize

Splits input string apart into tokens. reeeeeeally just splits on whitespace.