Module json_tokenizer

JSON tokenizer module that converts input text into a stream of JSON tokens.

This module handles the lexical analysis of JSON input, including support for various numeric formats, string escape sequences, and tracking of position information.

Structs

JsonTokenizer

Tokenizer that converts JSON input text into a stream of tokens.

Position

Represents a position in the input text.

Enums

Token