Crate udled_tokenizers 

Structs

AsciiWhitespace

Bool

Match ‘true’ or ‘false’

Float

Ident

Match a unicode identifier

Integer

LineFeed

RawLineComment

RawMultiLine

RawMultiLineNested

Space

Str

Whitespace

XmlIdent

Match a xml style tag or attribute

Functions

cstyle_line_comment

cstyle_multiline_comment

html_comment

javascript_doc_comment

python_line_comment

python_multiline_comment

rust_doc_comment