claw-parser-0.2.6
- claw-parser 0.2.6
- Permalink
- Docs.rs crate page
- MIT OR Apache-2.0
- Links
- Repository
- crates.io
- Source
- Owners
- esoterra
- Dependencies
- claw-ast ^0.2.6 normal
  claw-common ^0.2.6 normal
  cranelift-entity ^0.105.3 normal
  logos ^0.13.0 normal
  miette ^7.1.0 normal
  thiserror ^1.0.30 normal
  pretty_assertions ^1.1.0 dev
- Versions
- 0% of the crate is documented
Platform
Feature flags

docs.rs

Rust

tokenize

claw_parser0.2.6

Function tokenize

pub fn tokenize(
    src: Source,
    contents: &str,
) -> Result<Vec<TokenData>, LexerError>