Enum ezno_parser::TSXToken
source · pub enum TSXToken {
Show 97 variants
IdentLiteral(String),
Keyword(TSXKeyword),
NumberLiteral(String),
SingleQuotedStringLiteral(String),
DoubleQuotedStringLiteral(String),
MultiLineComment(String),
Comment(String),
RegexLiteral(String),
RegexFlagLiteral(String),
TemplateLiteralStart,
TemplateLiteralChunk(String),
TemplateLiteralEnd,
TemplateLiteralExpressionStart,
TemplateLiteralExpressionEnd,
Comma,
SemiColon,
Colon,
Dot,
At,
Spread,
Assign,
Arrow,
OpenParentheses,
CloseParentheses,
OpenBrace,
CloseBrace,
OpenBracket,
CloseBracket,
OpenChevron,
CloseChevron,
Add,
Subtract,
Multiply,
Divide,
QuestionMark,
Exponent,
Modulo,
AddAssign,
SubtractAssign,
MultiplyAssign,
DivideAssign,
ExponentAssign,
ModuloAssign,
Increment,
Decrement,
BitwiseShiftLeft,
BitwiseShiftRight,
BitwiseShiftRightUnsigned,
BitwiseShiftLeftAssign,
BitwiseShiftRightAssign,
UnsignedBitwiseShiftRightAssign,
BitwiseOr,
BitwiseXOr,
BitwiseAnd,
BitwiseNot,
BitwiseOrAssign,
BitwiseAndAssign,
BitwiseXorAssign,
LogicalOr,
LogicalAnd,
LogicalNot,
LogicalOrAssign,
LogicalAndAssign,
Equal,
NotEqual,
StrictEqual,
StrictNotEqual,
GreaterThanEqual,
LessThanEqual,
OptionalChain,
NullishCoalescing,
NullishCoalescingAssign,
OptionalMember,
NonOptionalMember,
HashTag,
JSXOpeningTagStart,
JSXTagName(String),
JSXOpeningTagEnd,
JSXClosingTagStart,
JSXClosingTagName(String),
JSXSelfClosingTag,
JSXAttributeKey(String),
JSXAttributeAssign,
JSXAttributeValue(String),
JSXContent(String),
JSXContentLineBreak,
JSXExpressionStart,
JSXExpressionEnd,
JSXFragmentStart,
JSXFragmentEnd,
JSXComment(String),
DividesOperator,
InvertAssign,
ComposeOperator,
PipeOperator,
Cursor(EmptyCursorId),
EOS,
}
Expand description
All JS Tokens with extensions including TypeScript, JSX and more
Variants§
IdentLiteral(String)
Keyword(TSXKeyword)
NumberLiteral(String)
SingleQuotedStringLiteral(String)
DoubleQuotedStringLiteral(String)
MultiLineComment(String)
Comment(String)
RegexLiteral(String)
RegexFlagLiteral(String)
TemplateLiteralStart
TemplateLiteralChunk(String)
TemplateLiteralEnd
TemplateLiteralExpressionStart
TemplateLiteralExpressionEnd
Comma
SemiColon
Colon
Dot
At
Spread
Assign
Arrow
=>
OpenParentheses
(
CloseParentheses
)
OpenBrace
{
CloseBrace
}
OpenBracket
[
CloseBracket
]
OpenChevron
<
CloseChevron
>
Add
Subtract
Multiply
Divide
QuestionMark
Exponent
Modulo
AddAssign
SubtractAssign
MultiplyAssign
DivideAssign
ExponentAssign
ModuloAssign
Increment
Decrement
BitwiseShiftLeft
BitwiseShiftRight
BitwiseShiftRightUnsigned
BitwiseShiftLeftAssign
BitwiseShiftRightAssign
UnsignedBitwiseShiftRightAssign
BitwiseOr
BitwiseXOr
BitwiseAnd
BitwiseNot
BitwiseOrAssign
BitwiseAndAssign
BitwiseXorAssign
LogicalOr
LogicalAnd
LogicalNot
LogicalOrAssign
LogicalAndAssign
Equal
NotEqual
StrictEqual
StrictNotEqual
GreaterThanEqual
LessThanEqual
OptionalChain
NullishCoalescing
NullishCoalescingAssign
OptionalMember
?:
NonOptionalMember
’!:`
HashTag
For scripts thing
JSXOpeningTagStart
JSXTagName(String)
JSXOpeningTagEnd
JSXClosingTagStart
JSXClosingTagName(String)
This also covers the end of a token, thus no TSXToken::JSXClosingTagEnd
JSXSelfClosingTag
/>
JSXAttributeKey(String)
JSXAttributeAssign
JSXAttributeValue(String)
JSXContent(String)
JSXContentLineBreak
JSXExpressionStart
The start and end of expressions either as a node or a attribute
JSXExpressionEnd
JSXFragmentStart
JSXFragmentEnd
JSXComment(String)
DividesOperator
InvertAssign
ComposeOperator
PipeOperator
Cursor(EmptyCursorId)
Special cursor marker
EOS
Implementations§
source§impl TSXToken
impl TSXToken
pub fn is_comment(&self) -> bool
sourcepub fn is_expression_prefix(&self) -> bool
pub fn is_expression_prefix(&self) -> bool
Used for lexing regular expression and JSX literals differently
sourcepub fn from_slice(slice: &str) -> Self
pub fn from_slice(slice: &str) -> Self
Returns a keyword token else an identifier literal
Trait Implementations§
source§impl FiniteAutomataConstructor for TSXToken
impl FiniteAutomataConstructor for TSXToken
type FiniteAutomata = States
fn new_automaton() -> States
source§impl PartialEq<TSXToken> for TSXToken
impl PartialEq<TSXToken> for TSXToken
source§impl TokenTrait for TSXToken
impl TokenTrait for TSXToken
source§fn is_skippable(&self) -> bool
fn is_skippable(&self) -> bool
Use this for nully tokens. Will be skipped TokenReader::expect_next