pub struct AttnPrep {
pub qr: Vec<f32>,
pub idxs: Vec<usize>,
pub win_len: usize,
}Expand description
What the host still owes the device before a layer frame can run: the shared LoRA vector the indexer reads, and the attended position list.
Fields§
§qr: Vec<f32>§idxs: Vec<usize>§win_len: usizeTrait Implementations§
Auto Trait Implementations§
impl Freeze for AttnPrep
impl RefUnwindSafe for AttnPrep
impl Send for AttnPrep
impl Sync for AttnPrep
impl Unpin for AttnPrep
impl UnsafeUnpin for AttnPrep
impl UnwindSafe for AttnPrep
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more