The lexical_scanner procceses supports over 115+ various tokens. All major punctuation patterns are supported.
Token field and description for lexical_scanner
