pub struct SpecTail<'a> {
pub lm: GraphW<'a>,
pub lm_rows: usize,
pub final_norm: &'a [f32],
pub logits_out: &'a mut Vec<f32>,
}Expand description
Speculative-verify tail for the batched graph: fold final-norm + lm_head
over every batch position and read all k logit rows back; the batch also
snapshots the GDN state per position for gdn_spec_restore.
Fields§
§lm: GraphW<'a>§lm_rows: usize§final_norm: &'a [f32]§logits_out: &'a mut Vec<f32>Auto Trait Implementations§
impl<'a> !UnwindSafe for SpecTail<'a>
impl<'a> Freeze for SpecTail<'a>
impl<'a> RefUnwindSafe for SpecTail<'a>
impl<'a> Send for SpecTail<'a>
impl<'a> Sync for SpecTail<'a>
impl<'a> Unpin for SpecTail<'a>
impl<'a> UnsafeUnpin for SpecTail<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more