Struct TokenizeLimits 

pub struct TokenizeLimits {
    pub max_tokens: usize,
    pub max_nesting: usize,
    pub max_text_bytes: usize,
}

Limits for bounded tokenization to prevent unbounded Vec growth.

Fields

max_tokens: usize

Maximum number of tokens to emit before returning an error.

max_nesting: usize

Maximum nesting depth for element stack.

max_text_bytes: usize

Maximum text node size in bytes before truncation.

Implementations

impl TokenizeLimits

pub fn embedded() -> Self

Create limits suitable for embedded environments.

Trait Implementations

impl Clone for TokenizeLimits

fn clone(&self) -> TokenizeLimits

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenizeLimits

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TokenizeLimits

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for TokenizeLimits

fn eq(&self, other: &TokenizeLimits) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for TokenizeLimits

impl Eq for TokenizeLimits

impl StructuralPartialEq for TokenizeLimits