Struct Token 

pub struct Token<T>
where
    T: PartialEq + Clone + Debug,
{
    pub is_left_joinable: bool,
    pub is_right_joinable: bool,
    /* private fields */
}

A token with a normalized form (used for diffing) and an original form (used when applying operations). Joinability flags control whether adjacent insertions interleave or group.

UTF-8 compatible.

Fields

is_left_joinable: bool

Whether the token is semantically joinable with the previous token

is_right_joinable: bool

Whether the token is semantically joinable with the next token

Implementations

impl<T> Token<T>

where T: PartialEq + Clone + Debug,

pub fn new( normalized: T, original: String, is_left_joinable: bool, is_right_joinable: bool, ) -> Self

pub fn original(&self) -> &str

pub fn set_normalized(&mut self, normalized: T)

pub fn normalized(&self) -> &T

pub fn get_original_length(&self) -> usize

Trait Implementations

impl<T> Clone for Token<T>

where T: PartialEq + Clone + Debug + Clone,

fn clone(&self) -> Token<T>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T> Debug for Token<T>

where T: PartialEq + Clone + Debug + Debug,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<&str> for Token<String>

Trivial implementation of Token when the normalized form is the same as the original string

fn from(text: &str) -> Self

Converts to this type from the input type.

impl<T> PartialEq for Token<T>

where T: PartialEq + Clone + Debug,

fn eq(&self, other: &Self) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.