Struct ByteClasses 

pub struct ByteClasses { /* private fields */ }

Dialect-owned byte-class data for the tokenizer hot loop.

Implementations

impl ByteClasses

pub const STANDARD: Self

Standard M1 byte classes: the ANSI baseline shared by every preset except PostgreSQL/MySQL (which layer the vertical tab as full whitespace) and SQLite/DuckDB (which layer their measured position-dependent vertical-tab rules — see SQLITE_BYTE_CLASSES / DUCKDB_BYTE_CLASSES).

pub const fn byte_class(&self, byte: u8) -> u8

Return all classes for byte.

pub const fn has_class(&self, byte: u8, mask: u8) -> bool

Return true if byte has any class in mask.

pub const fn has_boundary_whitespace(&self) -> bool

Whether any byte carries CLASS_WHITESPACE_BOUNDARY — the tokenizer’s cheap gate for the interior-boundary guard (true only for the DuckDB preset).

pub const fn with_class(self, byte: u8, mask: u8) -> Self

Return a copy with mask added to byte.

Trait Implementations

impl Clone for ByteClasses

fn clone(&self) -> ByteClasses

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ByteClasses

impl Debug for ByteClasses

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ByteClasses

impl PartialEq for ByteClasses

fn eq(&self, other: &ByteClasses) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ByteClasses