Struct tokenizer_lib::ParallelTokenQueue [−][src]
pub struct ParallelTokenQueue;
Expand description
A token queue used for doing lexing and parsing on different threads. Will send tokens between threads
Implementations
Creates two items, a sender and a receiver. Where the reader is on the parsing thread and the sender is on the lexer thread