[−][src]Crate ress
js_parse A crate for parsing raw JS into a token stream
The primary interfaces are the function tokenize
and
the struct Scanner
. The Scanner
struct impls Iterator
and the tokenize
function is just a wrapper
around Scanner::collect()
.
The Scanner
will provide a stream of Item
s, and Item
is
has 2 properties a Token
and a Span
. The Span
is a
representation of where the Item
exists in the original source while the Token
provides details about what JavaScript token it represents.
An example of what a token stream might look like
Re-exports
pub use comments::Comment; |
pub use comments::Kind as CommentKind; |
pub use keywords::Keyword; |
pub use numeric::Number; |
pub use punct::Punct; |
pub use regex::RegEx; |
pub use strings::StringLit; |
pub use strings::Template; |
pub use tokens::BooleanLiteral as Boolean; |
pub use tokens::Ident; |
pub use tokens::Item; |
pub use tokens::Span; |
pub use tokens::Token; |
Modules
comments | |
error | |
keywords | |
numeric | |
punct | |
refs | |
regex | |
strings | |
tokens | |
unicode |
Structs
Scanner | An iterator over a js token stream |
ScannerState |
Enums
OpenCurlyKind |
Functions
tokenize | a convince function for collecting a scanner into
a |