Skip to main content

Module tokenizer

Module tokenizer 

Source
Expand description

PostScript tokenizer.

Converts a byte stream into a sequence of tokens following the PLRM tokenization rules: numbers, names, strings, hex strings, procedures.

Structs§

Tokenizer
PostScript tokenizer.

Enums§

Token
A single PostScript token.

Functions§

stream_next_token
Read the next token from a file/filter stream, one byte at a time.