castle_tokenizer-0.20.2
- castle_tokenizer 0.20.2
- Permalink
- Docs.rs crate page
- MIT
- Links
- crates.io
- Source
- Owners
- AlbertMarashi
- Dependencies
- castle_input_cursor ^0.20.2 normal
  
  castle_types ^0.20.2 normal
  
  fast-float ^0.2.0 normal
  
  serde ^1.0.117 normal
- Versions
- 0% of the crate is documented
Platform
Feature flags

docs.rs
- About docs.rs
- Privacy policy

Rust

castle_tokenizer0.20.2

All Items

Crate Items

Modules
Structs
Enums
Traits

Crate castle_tokenizer

Modules§

extensions

Structs§

Token
Tokenizer

Enums§

Keyword
Punctuator
TokenKind

Traits§

Tokenizable