Struct InMemoryPipelineCache 

pub struct InMemoryPipelineCache { /* private fields */ }

In-memory pipeline cache - zero-persistence, zero-network, sharded FxHashMaps behind mutexes so concurrent get/put on different fingerprints rarely contend (VYRE_RUNTIME / PERF hot-cache audit).

Implementations

impl InMemoryPipelineCache

pub fn new() -> Self

Construct an empty cache.

pub fn with_limits( max_entries_per_shard: usize, max_bytes_per_shard: usize, ) -> Self

Construct an empty cache with explicit per-shard entry and byte budgets.

A zero entry budget or zero byte budget creates a disabled cache that accepts put calls but retains no artifacts.

pub fn len(&self) -> usize

Current entry count. Thread-safe snapshot.

pub fn cached_bytes(&self) -> usize

Current cached artifact bytes. Thread-safe snapshot.

pub fn is_empty(&self) -> bool

Whether the cache is empty.

pub fn eviction_reports(&self) -> Vec<InMemoryEvictionReport>

Snapshot the most recent eviction report from every shard that has evicted at least one artifact.

Trait Implementations

impl Debug for InMemoryPipelineCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InMemoryPipelineCache

fn default() -> Self

Returns the “default value” for a type.

impl PipelineCacheStore for InMemoryPipelineCache

fn get_arc(&self, fp: &PipelineFingerprint) -> Option<Arc<Vec<u8>>>

V7-PERF-009: zero-clone hot-path lookup. The cache already stores payloads behind Arc<Vec<u8>>, so a hit is one refcount bump.

fn get(&self, fp: &PipelineFingerprint) -> Option<Vec<u8>>

Look up a cached artifact for this fingerprint.

fn put(&self, fp: PipelineFingerprint, artifact: Vec<u8>)

Insert a pre-compiled artifact. Implementations may dedupe or evict per their own policy.

fn metrics(&self) -> PipelineCacheMetrics

Snapshot cache instrumentation for latency, throughput, and eviction gates. Backends that do not maintain counters return zeros.

fn flush(&self) -> Result<()>

Durably flush artifacts that were accepted by Self::put.