dune-0.1.9
- dune 0.1.9
- Permalink
- Docs.rs crate page
- Apache-2.0
- Links
- Homepage
- Documentation
- Repository
- crates.io
- Source
- Owners
- adam-mcdaniel
- Dependencies
- chess-engine ^0.1.2 normal
  chrono ^0.4 normal
  clap ^3.0 normal
  common_macros ^0.1 normal
  ctrlc ^3.2 normal
  detached-str ^0.1 normal
  dirs ^4.0 normal
  dunce ^1.0 normal
  json ^0.12.4 normal
  nom ^7.0 normal
  os_info ^3.0 normal
  prettytable-rs ^0.10 normal
  rand ^0.8 normal
  rustyline ^9.1 normal
  rustyline-derive ^0.6 normal
  snailquote ^0.3 normal
  terminal_size ^0.1.17 normal
  textwrap ^0.14 normal
  toml ^0.5.8 normal
  criterion ^0.3 dev
- Versions
Platform
Feature flags

Rust

dune0.1.9

Function dune::tokenize

pub fn tokenize(input: &str) -> (Vec<Token>, Vec<Diagnostic>)