Skip to main content

Module tokenizer

surrealdb_expr::expr

Module tokenizer

Structs§

SegmentLanguageWalker: Walker for a revisioned enum. Generated by #[revisioned(...)].
TokenizerWalker: Walker for a revisioned enum. Generated by #[revisioned(...)].

Enums§

SegmentLanguage: The language a Tokenizer::Segment segments with.
Tokenizer