Struct TokError 

pub struct TokError {
    pub err_message: String,
    pub produced: usize,
    pub location: usize,
    pub pairing_error: Option<(String, bool)>,
}

Tokenizer error state.

Fields

err_message: String

Human-readable error message. Format is not guaranteed and may change arbitrarily.

produced: usize

Number of tokens produced so far.

location: usize

At what byte index in the input string did tokenization fail to continue?

pairing_error: Option<(String, bool)>

Is Some if tokenization failed because of failing to pair brackets:

• String: responsible token text
• bool: openness

If the bool is true, then the failed pairing is “open”, like the string ()(. Otherwise, it’s “closed”, like ()).

The responsible token is the token where the error was noticed, not the token that’s “missing”. E.g. for ()) it’s ")".

It is currently unspecified whether non-nested overlaps like ( { ) } trigger an error.

KNOWN BUG: “open” failed pairings like ()( do not currently produce errors. They will become errors in a future version.

Trait Implementations

impl Clone for TokError

fn clone(&self) -> TokError

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.