Crate udled_tokenizers

Source

Structs§

Bool
Match ‘true’ or ‘false’
Float
Match a rust style float
Ident
Match a unicode identifier
Int
Match a rust style integer
Integer
Match a integer
LineComment
Match a c style line comment
MultiLineComment
Match a c style multiline comments with support for nested comments
Position
Punctuated
Match a list of T’s separated by P’s. Possible to allow trailing P’s
Range
RawLineComment
RawMultiLine
RawMultiLineNested
Str
XmlIdent
Match a xml style tag or attribute

Functions§

cstyle_line_comment
cstyle_multiline_comment
html_comment
javascript_doc_comment
python_line_comment
python_multiline_comment
rust_doc_comment