Struct KernelCache 

pub struct KernelCache { /* private fields */ }

A cache that stores multiple KernelSpec entries and provides lookup.

Implementations

impl KernelCache

pub fn new() -> Self

Creates an empty KernelCache.

pub fn add(&mut self, spec: KernelSpec)

Adds a kernel spec to the cache.

pub fn find(&self, kt: &KernelType) -> Option<&KernelSpec>

Finds the first spec whose kernel_type matches kt.

pub fn total_memory_estimate_bytes(&self) -> u64

Estimates total GPU memory required for all cached specs (bytes).

Each element occupies 4 bytes (f32), multiplied by channel count.

pub fn kernel_count(&self) -> usize

Returns the number of specs in the cache.

Trait Implementations

impl Debug for KernelCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for KernelCache

fn default() -> KernelCache

Returns the “default value” for a type.