Struct Tokenizer 

pub struct Tokenizer {
    pub items: Vec<Token>,
    /* private fields */
}

A tokenizer for Excel worksheet formulas.

Fields

items: Vec<Token>

Implementations

impl Tokenizer

pub fn new(formula: &str) -> Result<Self, TokenizerError>

Create a new tokenizer and immediately parse the formula.

pub fn new_best_effort(formula: &str) -> Self

Recover malformed syntax without returning a Result. Check Self::admission_error before using output: resource rejection produces empty output rather than a silently truncated formula.

pub fn new_best_effort_with_dialect( formula: &str, dialect: FormulaDialect, ) -> Self

Create a new tokenizer with best-effort parsing for the specified dialect.

pub fn new_with_dialect( formula: &str, dialect: FormulaDialect, ) -> Result<Self, TokenizerError>

Create a new tokenizer for the specified formula dialect.

pub fn from_token_stream(stream: &TokenStream) -> Self

pub fn admission_error(&self) -> Option<&TokenizerError>

Why an infallible best-effort/stream constructor could not admit input.

pub fn render(&self) -> String

Reconstruct the formula from the parsed tokens.

pub fn dialect(&self) -> FormulaDialect

Return the dialect used when tokenizing this formula.

Trait Implementations

impl TryFrom<&str> for Tokenizer

type Error = TokenizerError

The type returned in the event of a conversion error.

fn try_from(value: &str) -> Result<Self, Self::Error>

Performs the conversion.

impl TryFrom<String> for Tokenizer

type Error = TokenizerError

The type returned in the event of a conversion error.

fn try_from(value: String) -> Result<Self, Self::Error>

Performs the conversion.