Module memo_cache 

Higher-level inference memoization cache keyed by (expr_fingerprint, input_hash).

This module provides a memoization layer distinct from the lower-level TensorCache in cache.rs. Entries are keyed by a MemoKey that combines an expression fingerprint (derived from a TLExpr) with an optional hash over input values.

Structs

MemoCache

A memoization cache for inference results keyed by MemoKey.

MemoCacheBuilder

Builder for MemoCache, following the COOLJAPAN builder pattern.

MemoConfig

Configuration for a MemoCache.

MemoKey

Key for memoized results.

MemoStats

Runtime statistics for a MemoCache.

Enums

MemoEvictionPolicy

Eviction policy for the memo cache.

MemoLookupResult

The outcome of a MemoCache::get call.

Type Aliases

ExprMemoCache

Type alias for the primary use-case: caching ArrayD<f64> inference results.