pub struct O1DeviceView<'a> {Show 16 fields
pub m_eff: usize,
pub w: usize,
pub sink_len: usize,
pub d: usize,
pub dv: usize,
pub exact_only: bool,
pub scale: f32,
pub win_len: usize,
pub win_head: usize,
pub far_len: usize,
pub win_k: &'a [f32],
pub win_v: &'a [f32],
pub sink_k: &'a [f32],
pub sink_v: &'a [f32],
pub k_tilde: &'a [f32],
pub heads: Vec<O1HeadView<'a>>,
}Expand description
Borrowed view of a sealed group’s state for the GPU upload — every
slice the device mirror needs, in the layout the kernels index.
exact_only groups (degenerate short prompts) are not portable and
make the caller refuse the GPU path for the layer.
Fields§
§m_eff: usize§w: usize§sink_len: usize§d: usize§dv: usize§exact_only: bool§scale: f32§win_len: usize§win_head: usize§far_len: usize§win_k: &'a [f32]§win_v: &'a [f32]§sink_k: &'a [f32]§sink_v: &'a [f32]§k_tilde: &'a [f32]§heads: Vec<O1HeadView<'a>>Auto Trait Implementations§
impl<'a> Freeze for O1DeviceView<'a>
impl<'a> RefUnwindSafe for O1DeviceView<'a>
impl<'a> Send for O1DeviceView<'a>
impl<'a> Sync for O1DeviceView<'a>
impl<'a> Unpin for O1DeviceView<'a>
impl<'a> UnsafeUnpin for O1DeviceView<'a>
impl<'a> UnwindSafe for O1DeviceView<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more