Module tokenizer 

Low-level PDF tokenizer.

Tokenizes raw PDF bytes into a sequence of tokens: numbers, strings, names, booleans, null, delimiters, keywords, and indirect references.

Structs

Tokenizer

PDF tokenizer: produces tokens from a byte slice.

Enums

Token

A PDF token produced by the tokenizer.

Functions

is_delimiter

Returns true if b is a PDF delimiter character (ISO 32000 Table 2).

is_whitespace

Returns true if b is a PDF whitespace character (ISO 32000 Table 1).