pub struct ForwardOut {
pub logits: Vec<f32>,
pub h_last: CudaSlice<f32>,
}Expand description
A full-trunk forward’s outputs: last-position logits + the final hc state (resident on the LAST stage — the MTP drafter’s input).
Fields§
§logits: Vec<f32>§h_last: CudaSlice<f32>Auto Trait Implementations§
impl Freeze for ForwardOut
impl RefUnwindSafe for ForwardOut
impl Send for ForwardOut
impl Sync for ForwardOut
impl Unpin for ForwardOut
impl UnsafeUnpin for ForwardOut
impl UnwindSafe for ForwardOut
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more