pub struct DynKCfg {
pub window: usize,
pub thr: f64,
pub k_floor: usize,
}Expand description
Bounded shape-aware spec admission (mtp10): rolling-accept-driven K decay. Every
round pushes its accept count into a window of the last window rounds; when the
window is full and its mean accept < thr (draft tokens per round, 0..=k), K steps
DOWN by one (never up — decay only, bounded and monotone) and the window resets so
decays are at least window rounds apart. At K = k_floor the decay stops; with
k_floor = 0 reaching it turns spec OFF for the REST of the generation (plain
greedy decode steps — the draft cost is what the collapsed shape was paying for).
Byte identity is untouched BY CONSTRUCTION at every K: committed tokens are always
the target rows’ argmax, and the plain tail IS the plain program.
Fields§
§window: usize§thr: f64§k_floor: usizeTrait Implementations§
Auto Trait Implementations§
impl Freeze for DynKCfg
impl RefUnwindSafe for DynKCfg
impl Send for DynKCfg
impl Sync for DynKCfg
impl Unpin for DynKCfg
impl UnsafeUnpin for DynKCfg
impl UnwindSafe for DynKCfg
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more