Struct Lexer 

pub struct Lexer<'a> { /* private fields */ }

A scanner over one file.

Implementations

impl<'a> Lexer<'a>

pub fn new(src: &'a [u8], file_start: BytePos, opts: Options) -> Lexer<'a>

A scanner over src, whose first byte sits at file_start.

pub fn diagnostics(&self) -> &[Diagnostic]

Everything the scan has complained about so far.

pub fn take_diagnostics(&mut self) -> Vec<Diagnostic>

Takes the diagnostics, leaving the scanner able to carry on.

pub fn next_token(&mut self, interner: &mut Interner) -> PpToken

The next preprocessing token, or an end of file token at the end.

pub fn header_name(&mut self, interner: &mut Interner) -> Option<PpToken>

Scans a header name, which only a #include line can ask for.

Returns None when the line does not begin with < or ", which is the computed include case: the directive has to macro expand the line and try again. The scanner cannot make this call itself, because <stdio.h> and a pair of comparisons are the same bytes and only the directive knows which one is possible here.

Trait Implementations

impl<'a> Debug for Lexer<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.