Struct rust_tokenizers::Offset [−][src]
pub struct Offset { pub begin: OffsetSize, pub end: OffsetSize, }
Expand description
Offset information (in unicode points) to relate a token back to its original input string
Fields
begin: OffsetSize
end: OffsetSize
Implementations
Create a new offset from a begin and end positions
Wrap the offset into an option
Trait Implementations
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
[src]
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
[src]Deserialize this value from the given Serde deserializer. Read more
This method returns an ordering between self
and other
values if one exists. Read more
This method tests less than (for self
and other
) and is used by the <
operator. Read more
This method tests less than or equal to (for self
and other
) and is used by the <=
operator. Read more
This method tests greater than (for self
and other
) and is used by the >
operator. Read more
Auto Trait Implementations
impl RefUnwindSafe for Offset
impl UnwindSafe for Offset
Blanket Implementations
Mutably borrows from an owned value. Read more