mun_syntax-0.4.0
- mun_syntax 0.4.0
- Permalink
- Docs.rs crate page
- MIT OR Apache-2.0
- Links
- Homepage
- Documentation
- Repository
- crates.io
- Source
- Owners
- Wodann
- baszalmstra
- Dependencies
- drop_bomb ^0.1.4 normal
  
  itertools ^0.10.0 normal
  
  mun_abi ^0.4.0 normal
  
  ra_ap_text_edit ^0.0.142 normal
  
  rowan ^0.15.5 normal
  
  smol_str ^0.1.21 normal
  
  text-size ^1.1.0 normal
  
  unicode-xid ^0.2.3 normal
  
  insta ^1.12.0 dev
- Versions
- 21.27% of the crate is documented
Platform
Feature flags

docs.rs

Rust

mun_syntax0.4.0

Function tokenize

pub fn tokenize(text: &str) -> Vec<Token>

Expand description

Break a string up into its component tokens