Module text_scanner::ext

Scanner extensions for scanning e.g. Rust, C, Python.

See the any-lexer crate for lexer implementations using text-scanner, e.g. RustLexer using RustScannerExt.

Constants

• JAVA_CONTEXTUAL_KEYWORDS
  Reference: https://docs.oracle.com/javase/specs/jls/se20/html/jls-3.html#jls-3.9
• JAVA_OPERATORS
  Reference: https://docs.oracle.com/javase/specs/jls/se20/html/jls-3.html#jls-3.12
• JAVA_RESERVED_KEYWORDS
  Reference: https://docs.oracle.com/javase/specs/jls/se20/html/jls-3.html#jls-3.9
• JAVA_SEPARATORS
  Reference: https://docs.oracle.com/javase/specs/jls/se20/html/jls-3.html#jls-3.11
• PYTHON_DELIMITERS
• PYTHON_KEYWORDS
• PYTHON_OPERATORS
• PYTHON_SOFT_KEYWORDS

Traits

• CScannerExt
  Scanner extension for scanning C tokens.
• CssScannerExt
  Scanner extension for scanning CSS tokens.
• JavaScannerExt
  Scanner extension for scanning Java tokens.
• JavaStrExt
  str extension for checking if a &str is e.g. a Java keyword.
• JsonCScannerExt
  Scanner extension for scanning JSON with Comments tokens.
• JsonScannerExt
  Scanner extension for scanning JSON tokens.
• PythonScannerExt
  Scanner extension for scanning Python tokens.
• PythonStrExt
  str extension for checking if a &str is e.g. a Python keyword.
• RustScannerExt
  Scanner extension for scanning Rust tokens.
• ScssScannerExt
  Scanner extension for scanning SCSS tokens.