Module validator

Module validator 

Source
Expand description

Validates the tokens generated by the tokenizer.

Structs§

TokenIterator
Yields tokens, while maintaining the byte offset of the latest token.

Enums§

ValidationError
Error class raised by the validator.

Functions§

validate
Validates the tokens generated by the tokenizer.