#[non_exhaustive]pub struct TokenizeState {
pub word_index: usize,
}Expand description
Saccade bookkeeping shared across several tokenize_with_state calls,
so to_html keeps counting words across markup (SPEC §4).
Fields (Non-exhaustive)§
This struct is marked as non-exhaustive
Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional
Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.word_index: usizeIndex of the next word token; the first word of the input is 0.
Trait Implementations§
Source§impl Clone for TokenizeState
impl Clone for TokenizeState
impl Copy for TokenizeState
Source§impl Debug for TokenizeState
impl Debug for TokenizeState
Source§impl Default for TokenizeState
impl Default for TokenizeState
impl Eq for TokenizeState
Source§impl Hash for TokenizeState
impl Hash for TokenizeState
Source§impl PartialEq for TokenizeState
impl PartialEq for TokenizeState
impl StructuralPartialEq for TokenizeState
Auto Trait Implementations§
impl Freeze for TokenizeState
impl RefUnwindSafe for TokenizeState
impl Send for TokenizeState
impl Sync for TokenizeState
impl Unpin for TokenizeState
impl UnsafeUnpin for TokenizeState
impl UnwindSafe for TokenizeState
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more