Struct tokenizer_lib::Token
source · pub struct Token<T: TokenTrait, TData>(pub T, pub TData);
Expand description
A structure with a piece of data and some additional data such as a position
Tuple Fields§
§0: T
§1: TData
pub struct Token<T: TokenTrait, TData>(pub T, pub TData);
A structure with a piece of data and some additional data such as a position
0: T
§1: TData