ra_syntax-0.1.0
- ra_syntax 0.1.0
- Permalink
- Docs.rs crate page
- MIT OR Apache-2.0
- Links
- Repository
- Crates.io
- Source
- Owners
- matklad
- Dependencies
- drop_bomb ^0.1.4 normal
  itertools ^0.7.8 normal
  parking_lot ^0.6.0 normal
  rowan ^0.1.1 normal
  text_unit ^0.1.5 normal
  unicode-xid ^0.1.0 normal
  walkdir ^2.2.0 dev
- Versions
- 100% of the crate is documented
Platform
Feature flags

Rust

In ra_syntax

Function ra_syntax::tokenize

pub fn tokenize(text: &str) -> Vec<Token>

Expand description

Break a string up into its component tokens