mun_syntax-0.2.0
- mun_syntax 0.2.0
- Docs.rs crate page
- MIT OR Apache-2.0
- Links
- Repository
- crates.io
- Source
- Owners
- Wodann
- baszalmstra
- Dependencies
- mun_abi =0.2.0 normal
  drop_bomb ^0.1.4 normal
  rowan ^0.6.1 normal
  smol_str ^0.1.12 normal
  text_unit ^0.1.6 normal
  unicode-xid ^0.1.0 normal
  insta ^0.12.0 dev
- Versions
Go to latest version
Platform
Feature flags

docs.rs

Rust

☰

[−][src]Function mun_syntax::tokenize

pub fn tokenize(text: &str) -> Vec<Token>

Break a string up into its component tokens