pub struct TrimAdapt { /* private fields */ }Expand description
Serve-time adaptive trim (MEMRA_GEMMA_TRIM_ADAPT=n_spare extra rows and learns them — prompt ids up front, corrections as they land.
First miss pays one rejected round; every recurrence after is proposable. Rows are written
into the existing device buffers (no realloc — captured graphs keep their baked addresses).
Auto Trait Implementations§
impl Freeze for TrimAdapt
impl RefUnwindSafe for TrimAdapt
impl Send for TrimAdapt
impl Sync for TrimAdapt
impl Unpin for TrimAdapt
impl UnsafeUnpin for TrimAdapt
impl UnwindSafe for TrimAdapt
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more