protospec-build-0.3.0
- protospec-build 0.3.0
- Docs.rs crate page
- MIT
- Links
- Repository
- crates.io
- Source
- Owners
- Protryon
- Dependencies
- case ^1.0 normal
  indexmap ^1.6 normal
  proc-macro2 ^1.0 normal
  quote ^1.0 normal
  serde ^1.0 normal
  serde_json ^1.0 normal
  syn ^1.0 normal
  thiserror ^1.0 normal
  uuid ^0.8 normal
- Versions
- 2.16% of the crate is documented
Platform
Feature flags

docs.rs

Rust

tokenize

protospec_build0.3.0

In protospec_build::tokenizer

protospec_build::tokenizer

Function tokenize

pub fn tokenize(input: &str, strip_comments: bool) -> Result<Vec<SpannedToken>>