Struct LexemeInterner 

pub struct LexemeInterner { /* private fields */ }

Deduplicating store of Lexemes, typically one per lexed file.

Interning the same text twice returns two handles to one allocation. The interner is an implementation detail of memory layout: it never affects token equality or fingerprints, which follow text content only.

Implementations

impl LexemeInterner

pub fn new() -> Self

Create an empty interner.

pub fn intern(&mut self, text: &str) -> Lexeme

Return the shared lexeme for text, allocating it once.

Trait Implementations

impl Debug for LexemeInterner

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LexemeInterner

fn default() -> LexemeInterner

Returns the “default value” for a type.