Enum ScanToken 

pub enum ScanToken {
    ObjectStart,
    ObjectEnd,
    ArrayStart,
    ArrayEnd,
    Colon,
    Comma,
    Null,
    True,
    False,
    String {
        start: usize,
        end: usize,
        has_escapes: bool,
    },
    Number {
        start: usize,
        end: usize,
        hint: NumberHint,
    },
    Eof,
    NeedMore {
        consumed: usize,
    },
}

Token kinds with minimal data - strings/numbers are just indices into the buffer.

Variants

ObjectStart

{

ObjectEnd

}

ArrayStart

[

ArrayEnd

]

Colon

:

Comma

,

Null

null

True

true

False

false

String

A string literal - indices point to content (excluding quotes)

Fields

start: usize

Start index of string content (after opening quote)

end: usize

End index of string content (before closing quote)

has_escapes: bool

True if the string contains escape sequences that need processing

Number

A number literal - indices point to the raw number text

Fields

start: usize

Start index of number

end: usize

End index of number

hint: NumberHint

Hint about number format

Eof

End of input reached

NeedMore

Buffer exhausted mid-token - need refill for streaming

Fields

consumed: usize

How many bytes were consumed before hitting the boundary

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Token