Struct rhai::TokenizeState
source · pub struct TokenizeState {
pub max_string_size: Option<NonZeroUsize>,
pub next_token_cannot_be_unary: bool,
pub tokenizer_control: TokenizerControl,
pub comment_level: usize,
pub include_comments: bool,
pub is_within_text_terminated_by: Option<char>,
}
Expand description
(internals) State of the tokenizer.
Exported under the internals
feature only.
Fields
max_string_size: Option<NonZeroUsize>
Maximum length of a string.
next_token_cannot_be_unary: bool
Can the next token be a unary operator?
tokenizer_control: TokenizerControl
Shared object to allow controlling the tokenizer externally.
comment_level: usize
Is the tokenizer currently inside a block comment?
include_comments: bool
Include comments?
is_within_text_terminated_by: Option<char>
Is the current tokenizer position within the text stream of an interpolated string?
Trait Implementations
sourceimpl Clone for TokenizeState
impl Clone for TokenizeState
sourcefn clone(&self) -> TokenizeState
fn clone(&self) -> TokenizeState
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moresourceimpl Debug for TokenizeState
impl Debug for TokenizeState
sourceimpl Default for TokenizeState
impl Default for TokenizeState
sourcefn default() -> TokenizeState
fn default() -> TokenizeState
Returns the “default value” for a type. Read more
sourceimpl PartialEq<TokenizeState> for TokenizeState
impl PartialEq<TokenizeState> for TokenizeState
sourcefn eq(&self, other: &TokenizeState) -> bool
fn eq(&self, other: &TokenizeState) -> bool
impl Eq for TokenizeState
impl StructuralEq for TokenizeState
impl StructuralPartialEq for TokenizeState
Auto Trait Implementations
impl !RefUnwindSafe for TokenizeState
impl !Send for TokenizeState
impl !Sync for TokenizeState
impl Unpin for TokenizeState
impl !UnwindSafe for TokenizeState
Blanket Implementations
sourceimpl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
const: unstable · sourcefn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more