Skip to main content

tokenize

Function tokenize 

Source
pub fn tokenize(input: &[u8]) -> Result<Vec<Operator>, BackendError>
Expand description

Parse PDF content stream bytes into a sequence of operators.

Each operator collects the operands that preceded it on the operand stack. Comments (% to end of line) are stripped. Inline images (BI/ID/EI) are handled as a special case.

ยงErrors

Returns BackendError::Interpreter for malformed content streams.