pub struct BeamSearchConfig {
pub max_blocks: usize,
pub max_explorations: Option<usize>,
}Expand description
Beam search configuration controlling how the fusion optimizer explores independent blocks of operations.
Fields§
§max_blocks: usizeMaximum number of independent blocks explored during the fusion search.
Higher values can find better fusion opportunities at the cost of more cache misses in the fusion cache.
max_explorations: Option<usize>Stop exploring new optimizations after this many explorations (per stream).
Each cache miss runs the (relatively expensive) optimizer to build a new optimization. A
graph whose relative form changes every step never caches, so it re-explores forever. Once
this cap is reached, cache-missing segments execute unfused (no optimizer work, nothing
added to the cache) instead. Cache hits are unaffected, so already-cached stable graphs
keep replaying. None (the default) never disables exploration.
Trait Implementations§
Source§impl Clone for BeamSearchConfig
impl Clone for BeamSearchConfig
Source§fn clone(&self) -> BeamSearchConfig
fn clone(&self) -> BeamSearchConfig
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more