Struct tokenizer_lib::ParallelTokenQueue
source · pub struct ParallelTokenQueue;
Expand description
A token queue used for doing lexing and parsing on different threads. Will send tokens between threads
Implementations§
source§impl ParallelTokenQueue
impl ParallelTokenQueue
sourcepub fn new<T: TokenTrait, TData>(
) -> (ParallelTokenSender<T, TData>, ParallelTokenReader<T, TData>)
pub fn new<T: TokenTrait, TData>( ) -> (ParallelTokenSender<T, TData>, ParallelTokenReader<T, TData>)
Creates two items, a sender and a receiver. Where the reader is on the parsing thread and the sender is on the lexer thread