Skip to main content

reset_pipeline_dispatch_buckets

Function reset_pipeline_dispatch_buckets 

Source
pub fn reset_pipeline_dispatch_buckets()
Expand description

Reset the per-pipeline dispatch buckets (typically called at decode start to ignore prefill / warmup contributions).