Module typos::tokens[][src]

Structs

Identifier

A term composed of Words.

Tokenizer

Extract Identifiers from a buffer.

TokenizerBuilder

Define rules for tokenizaing a buffer.

Word

An indivisible term.

Enums

Case

Format of the term.