Skip to main content

PrattTokenSource

sim_codec_algol

Trait PrattTokenSource 

Source 
pub trait PrattTokenSource: Send + Sync {
    // Required method
    fn tokenize_pratt(
        &self,
        codec: CodecId,
        source: &str,
        budget: &mut DecodeBudget,
    ) -> Result<Vec<SpannedPrattToken>, Error>;
}
Expand description

A lexer that turns source text into Pratt tokens for the shared driver.

Required Methods§

Source

fn tokenize_pratt( &self, codec: CodecId, source: &str, budget: &mut DecodeBudget, ) -> Result<Vec<SpannedPrattToken>, Error>

Tokenizes source under budget, using codec for budget diagnostics.

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§