Token

noa_parser::bytes::token

Enum Token

pub enum Token {
Show 33 variants    OpenParen,
    CloseParen,
    Comma,
    Semicolon,
    Colon,
    Whitespace,
    GreaterThan,
    LessThan,
    Exclamation,
    Quote,
    DoubleQuote,
    Equal,
    Plus,
    Dash,
    Slash,
    Star,
    Percent,
    Ampersand,
    Pipe,
    Caret,
    Tilde,
    Dot,
    Question,
    At,
    Hash,
    Dollar,
    Backslash,
    Underscore,
    Sharp,
    Ln,
    Cr,
    Tab,
    CrLn,
}

Expand description

The token type

Variants§

OpenParen

The “(” character

CloseParen

The ) character

Comma

The , character

Semicolon

The ; character

Colon

The : character

Whitespace

The whitespace character

GreaterThan

The > character

LessThan

The < character

Exclamation

The ! character

Quote

The ' character

DoubleQuote

The " character

Equal

The = character

Plus

The + character

Dash

The - character

Slash

The / character

Star

The * character

Percent

The % character

Ampersand

The & character

Pipe

The | character

Caret

The ^ character

Tilde

The ~ character

Dot

The . character

Question

The ? character

At

The @ character

Hash

The # character

Dollar

The $ character

Backslash

The \\ character

Underscore

The _ character

Sharp

The # character

Ln

The \n character

Cr

The \r character

Tab

The \t character

CrLn

The \r\n character

Trait Implementations§

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value. Read more

1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

impl Match<u8> for Token

fn matcher(&self, data: &[u8]) -> (bool, usize)

Returns true if the data matches the pattern. Read more

impl MatchSize for Token

fn size(&self) -> usize

Returns the size of the matchable object.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

1.0.0 · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl<'a> Peekable<'a, u8, Token, Token> for GroupKind

fn peek(&self, data: &Scanner<'a, u8>) -> ParseResult<PeekResult<Token, Token>>

Attempt to match the Peekable against the current position of the Scanner. Read more

impl<'a> Peekable<'a, u8, Token, Token> for UntilEnd<u8>

fn peek(&self, data: &Scanner<'a, u8>) -> ParseResult<PeekResult<Token, Token>>

Peeks at the current position of the Scanner until it reaches the end of the data.

§Arguments

data - The Scanner to use when matching.

§Returns

A PeekResult where the end_slice is the current position of the Scanner, and start and end are both ().

impl Copy for Token

impl StructuralPartialEq for Token

Auto Trait Implementations§

impl Freeze for Token

impl RefUnwindSafe for Token

impl Send for Token

impl Sync for Token

impl Unpin for Token

impl UnwindSafe for Token

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> CloneToUninit for T
where T: Clone,

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)

Performs copy-assignment from self to dest. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<'a, M> Recognizable<'a, u8, &'a [u8]> for M
where M: Match<u8> + MatchSize,

fn recognize( self, scanner: &mut Scanner<'a, u8>, ) -> Result<Option<&'a [u8]>, ParseError>

Try to recognize the object for the given scanner. Read more

impl<'a, T, M> RecognizeSelf<'a, T, M> for M
where M: Match<T> + MatchSize,

fn recognize_self( self, scanner: &mut Scanner<'a, T>, ) -> Result<Option<M>, ParseError>

Try to recognize the object for the given scanner. Read more

impl<T> ToOwned for T
where T: Clone,

type Owned = T

The resulting type after obtaining ownership.

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.