Enum rtf_grimoire::tokenizer::Token

pub enum Token {
    ControlSymbol(char),
    ControlWord {
        name: String,
        arg: Option<i32>,
    },
    ControlBin(Vec<u8>),
    Text(Vec<u8>),
    StartGroup,
    EndGroup,
    Newline,
}

Variants

ControlSymbol(char)ControlWord

Fields of ControlWord

name: Stringarg: Option<i32>

ControlBin(Vec<u8>)Text(Vec<u8>)

Text is not str because it can be in any of various encodings - it's up to the processor to identify any encoding information in the stream, and do any encoding conversion desired

StartGroupEndGroupNewline

Methods

impl Token

pub fn to_rtf(&self) -> Vec<u8>

pub fn token_delimiter_after(&self, next_token: &Token) -> &'static str

This function returns a control word delimiter if one is required, or an empty string if none is required

Control Word tokens must be delimited by a non-alphanumeric value, so if the subsequent content could be alphanumeric, a space (' ') delimiter must be inserted

pub fn token_delimiter_before(&self, prev_token: &Token) -> &'static str

This function returns a control word delimiter if one is required, or an empty string if none is required

Control Word tokens must be delimited by a non-alphanumeric value, so if the subsequent content could be alphanumeric, a space (' ') delimiter must be inserted

pub fn get_name(&self) -> Option<String>

pub fn get_arg(&self) -> Option<i32>

pub fn get_symbol(&self) -> Option<char>

pub fn get_bin(&self) -> Option<&[u8]>

pub fn get_text(&self) -> Option<&[u8]>

Trait Implementations

impl PartialEq<Token> for Token

fn eq(&self, other: &Token) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Token) -> bool

This method tests for !=.

impl Debug for Token

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.