Enum TokenKind 

#[non_exhaustive]
pub enum TokenKind {
    Keyword,
    Type,
    Function,
    String,
    Number,
    Comment,
    Operator,
    Punctuation,
    Variable,
    Constant,
    Tag,
    Attribute,
    Escape,
    Plain,
}

Classifies a token span into a stable highlighting category.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Keyword

Matches language keywords and storage scopes.

Type

Matches named types and type-like support scopes.

Function

Matches function and method names.

String

Matches string literal content.

Number

Matches numeric literals.

Comment

Matches comment text.

Operator

Matches operator scopes before generic keywords.

Punctuation

Matches punctuation and delimiter scopes.

Variable

Matches variable-like scopes.

Constant

Matches non-numeric constant scopes.

Tag

Matches tag names such as HTML elements.

Attribute

Matches attribute and property names.

Escape

Matches escape sequences inside literals.

Plain

Fallback when no supported scope prefix matches.

Trait Implementations

impl Clone for TokenKind

fn clone(&self) -> TokenKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for TokenKind

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for TokenKind

fn eq(&self, other: &TokenKind) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TokenKind

impl Eq for TokenKind

impl StructuralPartialEq for TokenKind