Struct TrieCache 

pub struct TrieCache { /* private fields */ }

A thread-safe, byte-bounded cache of byte-tries keyed by vocabulary fingerprint. Read-mostly after warm-up; once the budget is reached, further tries are built and returned but not retained.

Implementations

impl TrieCache

pub fn new() -> Self

An empty cache with the default byte budget and concurrent-build cap.

pub fn with_budget(budget: usize) -> Self

An empty cache with an explicit retained-byte budget.

pub fn with_build_limit(budget: usize, max_concurrent_builds: usize) -> Self

An empty cache with an explicit retained-byte budget and the default build gate.

pub fn with_build_gate( budget: usize, max_concurrent_builds: usize, max_transient_build_bytes: usize, ) -> Self

An empty cache with an explicit retained-byte budget, a concurrent-build count cap, AND a transient-build byte budget (so many large concurrent builds cannot exhaust memory).

pub fn peak_concurrent_builds(&self) -> usize

The peak number of simultaneous distinct-vocabulary builds observed (for tests/telemetry).

pub fn peak_concurrent_build_bytes(&self) -> usize

The peak concurrent transient-build bytes charged (for tests/telemetry).

pub fn get_or_build_byte( &self, vocab: &Vocabulary, ) -> Result<Arc<VocabTrie>, CompileError>

The cached byte-trie for vocab, building and inserting it on a miss. Two vocabularies with equal fingerprints get the same Arc; the trie is built outside the lock, so a rare double

pub fn bind( &self, handle: &VocabularyHandle, ) -> Result<BoundByteTrie, CompileError>

The byte-trie for handle’s vocabulary, wrapped as an opaque BoundByteTrie whose fingerprint is guaranteed (by construction, not by caller honesty) to be handle’s own -

pub fn clear(&self)

Drops every retained trie. Also clears the LRU touch-log, so repeated fill/clear cycles cannot accumulate stale log records indefinitely. Traffic counters (stats()) are NOT reset -

pub fn len(&self) -> usize

The number of retained tries.

pub fn is_empty(&self) -> bool

Whether the cache retains no trie.

pub fn bytes(&self) -> usize

Retained trie bytes. Bounds the CACHE only - a trie an active PyIndex/CompiledArtifact holds its own Arc to stays alive via that reference even if evicted or never cached here.

pub fn stats(&self) -> (u64, u64, u64, u64)

(hits, misses, evictions, oversized_bypasses) since creation - a lifetime traffic total, NOT reset by clear() (which only drops currently-retained content). Single-flight caps

Trait Implementations

impl Debug for TrieCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for TrieCache

fn default() -> Self

Returns the “default value” for a type.