Module luthor::tokenizer [−] [src]

Structs

StateFunction
Tokenizer	The Tokenizer type is used to produce and store tokens for the various language and format lexers.

Functions

new	Initializes a new tokenizer with the given data.

Keyboard Shortcuts

?: Show this help dialog
S: Focus the search field
⇤: Move up in search results
⇥: Move down in search results
⏎: Go to active search result
+: Collapse/expand all sections

Search Tricks

Prefix searches with a type followed by a colon (e.g. fn:) to restrict the search to a given type.

Accepted types are: fn, mod, struct, enum, trait, type, macro, and const.

Search functions by type signature (e.g. vec -> usize or * -> vec)