castle_tokenizer-0.20.2
- castle_tokenizer 0.20.2
- Permalink
- Docs.rs crate page
- MIT
- Links
- Crates.io
- Source
- Owners
- AlbertMarashi
- Dependencies
- castle_input_cursor ^0.20.2 normal
  
  castle_types ^0.20.2 normal
  
  fast-float ^0.2.0 normal
  
  serde ^1.0.117 normal
- Versions
- 0% of the crate is documented
Platform
Feature flags

Rust

Crate castle_tokenizer

Structs
Enums
Traits

List of all items

Structs

Token
Tokenizer

Enums

Keyword
Punctuator
TokenKind

Traits

Tokenizable
extensions::ExpectIdentifier
extensions::ExpectKeyword
extensions::ExpectNext
extensions::ExpectPrimitive
extensions::ExpectPunctuator
extensions::IsPunctuator
extensions::PeekKeyword