pub enum Token<'a> {
Show 31 variants Ident(CowRcStr<'a>), AtKeyword(CowRcStr<'a>), Hash(CowRcStr<'a>), IDHash(CowRcStr<'a>), QuotedString(CowRcStr<'a>), UnquotedUrl(CowRcStr<'a>), Delim(char), Number { has_sign: bool, value: f32, int_value: Option<i32>, }, Percentage { has_sign: bool, unit_value: f32, int_value: Option<i32>, }, Dimension { has_sign: bool, value: f32, int_value: Option<i32>, unit: CowRcStr<'a>, }, WhiteSpace(&'a str), Comment(&'a str), Colon, Semicolon, Comma, IncludeMatch, DashMatch, PrefixMatch, SuffixMatch, SubstringMatch, CDO, CDC, Function(CowRcStr<'a>), ParenthesisBlock, SquareBracketBlock, CurlyBracketBlock, BadUrl(CowRcStr<'a>), BadString(CowRcStr<'a>), CloseParenthesis, CloseSquareBracket, CloseCurlyBracket,
}
Expand description

One of the pieces the CSS input is broken into.

Some components use Cow in order to borrow from the original input string and avoid allocating/copying when possible.

Variants

Ident(CowRcStr<'a>)

AtKeyword(CowRcStr<'a>)

A <at-keyword-token>

The value does not include the @ marker.

Hash(CowRcStr<'a>)

A <hash-token> with the type flag set to “unrestricted”

The value does not include the # marker.

IDHash(CowRcStr<'a>)

A <hash-token> with the type flag set to “id”

The value does not include the # marker.

QuotedString(CowRcStr<'a>)

A <string-token>

The value does not include the quotes.

UnquotedUrl(CowRcStr<'a>)

A <url-token>

The value does not include the url( ) markers. Note that url( <string-token> ) is represented by a Function token.

Delim(char)

A <delim-token>

Number

Fields

has_sign: bool

Whether the number had a + or - sign.

This is used is some cases like the <An+B> micro syntax. (See the parse_nth function.)

value: f32

The value as a float

int_value: Option<i32>

If the origin source did not include a fractional part, the value as an integer.

Percentage

Fields

has_sign: bool

Whether the number had a + or - sign.

unit_value: f32

The value as a float, divided by 100 so that the nominal range is 0.0 to 1.0.

int_value: Option<i32>

If the origin source did not include a fractional part, the value as an integer. It is not divided by 100.

Dimension

Fields

has_sign: bool

Whether the number had a + or - sign.

This is used is some cases like the <An+B> micro syntax. (See the parse_nth function.)

value: f32

The value as a float

int_value: Option<i32>

If the origin source did not include a fractional part, the value as an integer.

unit: CowRcStr<'a>

The unit, e.g. “px” in 12px

WhiteSpace(&'a str)

Comment(&'a str)

A comment.

The CSS Syntax spec does not generate tokens for comments, But we do, because we can (borrowed &str makes it cheap).

The value does not include the /* */ markers.

Colon

A : <colon-token>

Semicolon

A ; <semicolon-token>

Comma

A , <comma-token>

IncludeMatch

DashMatch

PrefixMatch

SuffixMatch

SubstringMatch

CDO

A <!-- <CDO-token>

CDC

Function(CowRcStr<'a>)

A <function-token>

The value (name) does not include the ( marker.

ParenthesisBlock

A <(-token>

SquareBracketBlock

A <[-token>

CurlyBracketBlock

A <{-token>

BadUrl(CowRcStr<'a>)

A <bad-url-token>

This token always indicates a parse error.

BadString(CowRcStr<'a>)

A <bad-string-token>

This token always indicates a parse error.

CloseParenthesis

A <)-token>

When obtained from one of the Parser::next* methods, this token is always unmatched and indicates a parse error.

CloseSquareBracket

A <]-token>

When obtained from one of the Parser::next* methods, this token is always unmatched and indicates a parse error.

CloseCurlyBracket

A <}-token>

When obtained from one of the Parser::next* methods, this token is always unmatched and indicates a parse error.

Implementations

Return whether this token represents a parse error.

BadUrl and BadString are tokenizer-level parse errors.

CloseParenthesis, CloseSquareBracket, and CloseCurlyBracket are unmatched and therefore parse errors when returned by one of the Parser::next* methods.

Categorize a token into a type that determines when /**/ needs to be inserted between two tokens when serialized next to each other without whitespace in between.

See the TokenSerializationType::needs_separator_when_before method.

Trait Implementations

Returns a copy of the value. Read more

Performs copy-assignment from source. Read more

Formats the value using the given formatter. Read more

This method tests for self and other values to be equal, and is used by ==. Read more

This method tests for !=.

Serialize self in CSS syntax, writing to dest.

Serialize self in CSS syntax and return a string. Read more

Auto Trait Implementations

Blanket Implementations

Gets the TypeId of self. Read more

Immutably borrows from an owned value. Read more

Mutably borrows from an owned value. Read more

Returns the argument unchanged.

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

The resulting type after obtaining ownership.

Creates owned data from borrowed data, usually by cloning. Read more

🔬 This is a nightly-only experimental API. (toowned_clone_into)

Uses borrowed data to replace owned data, usually by cloning. Read more

The type returned in the event of a conversion error.

Performs the conversion.

The type returned in the event of a conversion error.

Performs the conversion.