pub struct BakeHyper {}Expand description
Hyper-parameters — defaults are the certified recipe.
Fields§
§steps_a: usize§steps_b: usize§l1_init: f64§l1_step: f64§eval_every: usize§lr_a: f64§lr_b: f64§tau: f32§fcd_layers: usize§seed: u64§target_sparsity: f64Target sparsity (0..1). When >0, the best checkpoint must have at least this fraction of neurons pruned; if none qualifies the highest-sparsity checkpoint is used.
l1_mult: f64L1 aggression multiplier: scales both l1_init and l1_step.
1.0 = harder pruning push, <1.0 = softer.
align: usizeRound each layer’s kept-neuron count UP to a multiple of this (0/1 = off). 32 keeps the defragged FFN on grouped codecs (in % 32 == 0) and SIMD kernels off their scalar tails.
uniform_inter: boolForce one FFN width across all layers (the max aligned count) — the whole-token GPU graphs require a uniform intermediate size.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for BakeHyper
impl RefUnwindSafe for BakeHyper
impl Send for BakeHyper
impl Sync for BakeHyper
impl Unpin for BakeHyper
impl UnsafeUnpin for BakeHyper
impl UnwindSafe for BakeHyper
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more