Module synoptic::tokens

This provides the types of tokens which you can use to apply your syntax highlighting into whichever format you please

Structs

Bounded

For representing a bounded token definition

FullToken

For storing all the data in a token to prevent overwriting This contains the contents, type, start and end of the token This is used to compare tokens to each other to prevent tokens inside tokens

Enums

TokOpt

An alternative way to store tokens, makes it easy to trim them

Token

For storing tokens to put into a string It has a start token, to mark the start of a token It has a text token, for the text inbetween and inside tokens It also has an end token, to mark the end of a token