Skip to main content

gc_unused_kernels

svod_runtime::kernel_cache

Function gc_unused_kernels 

Source 
pub fn gc_unused_kernels(live_ids: &HashSet<u64>)
Expand description

Remove kernels whose AST IDs are no longer in the live UOp set.

Call this after gc_dead_refs() to clean up compiled kernels for discarded UOps. This prevents kernel cache memory accumulation during beam search and other optimization passes.

§Arguments

  • live_ids - Set of UOp IDs that are still alive in the UOp cache

§Example

ⓘ
svod_ir::uop::gc_dead_refs();
let live_ids = svod_ir::uop::live_uop_ids();
svod_runtime::kernel_cache::gc_unused_kernels(&live_ids);