Module tokenizer
gedcom
Handles the tokenization of a GEDCOM file
The tokenizer that turns the gedcom characters into a list of tokens
The base enum of Token types