ress-0.7.0-beta.3
- ress 0.7.0-beta.3
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- FreeMasen
- Dependencies
- flate2 ^1 normal
  lazy_static ^1 normal
  log ^0.4 normal
  reqwest ^0.9 normal
  tar ^0.4 normal
  unic-ucd-category ^0.9 normal
  unic-ucd-ident ^0.9 normal
  docopt ^1.0 dev
  pretty_env_logger ^0.2 dev
  proptest ^0.8 dev
  regex_generate ^0.2.0 dev
  serde ^1.0 dev
  serde_derive ^1.0 dev
  walkdir ^2.2 dev
- Versions
Go to latest stable release
Platform
Feature flags

Rust

☰

[−][src]Function ress::tokenize

pub fn tokenize(text: &str) -> Result<Vec<RefToken>, Error>

a convince function for collecting a scanner into a Vec<Token>

Help

Keyboard Shortcuts

?: Show this help dialog
S: Focus the search field
↑: Move up in search results
↓: Move down in search results
↹: Switch tab
⏎: Go to active search result
+: Expand all sections
-: Collapse all sections

Search Tricks

Prefix searches with a type followed by a colon (e.g., fn:) to restrict the search to a given type.

Accepted types are: fn, mod, struct, enum, trait, type, macro, and const.

Search functions by type signature (e.g., vec -> usize or * -> vec)

Search multiple things at once by splitting your query with comma (e.g., str,u8 or String,struct:Vec,test)