Struct Lexer 

pub struct Lexer<'a> { /* private fields */ }

Streaming tokenizer over a byte slice. Holds a cursor into the input; advance with Lexer::next_token.

Implementations

impl<'a> Lexer<'a>

pub fn new(input: &'a [u8]) -> Self

pub fn position(&self) -> usize

Current byte offset.

pub fn seek(&mut self, pos: usize)

Move the cursor to an absolute byte offset. Used by the object parser when it needs to re-anchor (e.g. after consuming the stream keyword + its EOL marker, the parser jumps the cursor past the binary payload directly).

pub fn peek_byte(&self, offset: usize) -> Option<u8>

Peek at the byte at offset from the current position. Returns None past EOF.

pub fn slice(&self, start: usize, end: usize) -> &'a [u8]

Borrow a slice of the input from start to end (clamped to the input length). Used by the object parser for stream-body extraction.

pub fn input(&self) -> &'a [u8]

Whole input. Useful for the trailer / startxref scanner that works backward from EOF.

pub fn next_token(&mut self) -> Result<Option<Token<'a>>, PdfError>

Read the next token. Returns Ok(None) at EOF.