Struct ModuleBinaryCache 

pub struct ModuleBinaryCache { /* private fields */ }

An in-memory cache mapping (SPIR-V, build flags) to compiled native binaries, with hit/miss accounting.

A backend looks up a key before calling zeModuleCreate; on a miss it JITs the SPIR-V, retrieves the native binary, and inserts it so later identical modules skip the JIT. The cache is the host-side half of zeModuleGetNativeBinary persistence — serialising the map to disk (a trivial extension) gives cross-run reuse.

Implementations

impl ModuleBinaryCache

pub fn new() -> Self

An empty cache.

pub fn len(&self) -> usize

Number of cached binaries.

pub fn is_empty(&self) -> bool

true when nothing is cached.

pub fn hits(&self) -> u64

Cumulative cache hits.

pub fn misses(&self) -> u64

Cumulative cache misses.

pub fn hit_rate(&self) -> f64

Hit rate in [0, 1]; 0.0 when there have been no lookups.

pub fn lookup( &mut self, spirv: &[u32], build_flags: &str, ) -> Option<&NativeBinary>

Look up a compiled binary for spirv + build_flags, recording a hit or miss. Returns None on a miss (the caller must JIT and insert).

pub fn insert(&mut self, spirv: &[u32], binary: NativeBinary) -> u64

Insert a compiled native binary for spirv, returning its cache key.

The binary’s own build_flags are folded into the key so two builds of the same SPIR-V with different flags do not collide.

pub fn get(&self, key: u64) -> Option<&NativeBinary>

Fetch a binary by its precomputed key without affecting statistics.

pub fn clear(&mut self)

Remove all cached binaries (statistics are preserved).

pub fn total_bytes(&self) -> usize

Total bytes occupied by all cached native binaries.

Trait Implementations

impl Debug for ModuleBinaryCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ModuleBinaryCache

fn default() -> ModuleBinaryCache

Returns the “default value” for a type.