mun_syntax-0.3.0
- mun_syntax 0.3.0
- Docs.rs crate page
- MIT OR Apache-2.0
- Links
- Homepage
- Documentation
- Repository
- crates.io
- Source
- Owners
- Wodann
- baszalmstra
- Dependencies
- mun_abi =0.3.0 normal
  drop_bomb ^0.1.4 normal
  itertools ^0.10.0 normal
  ra_ap_text_edit ^0.0.35 normal
  rowan ^0.10.0 normal
  smol_str ^0.1.17 normal
  text-size ^1.1.0 normal
  unicode-xid ^0.1.0 normal
  insta ^0.16 dev
- Versions
- 22.17% of the crate is documented
Go to latest version
Platform
Feature flags

Rust

☰

Function mun_syntax::tokenize[−][src]

pub fn tokenize(text: &str) -> Vec<Token>

Break a string up into its component tokens