#[repr(C)]pub struct RopeParams {}Expand description
Layout for Rope.
Fields§
§n_total: u32§seq: u32§head_dim: u32§half: u32§in_off: u32§cos_off: u32§sin_off: u32§out_off: u32§last_dim: u32§batch: u32PLAN L1 — set at compile time. Together with seq_stride,
lets the WGSL kernel decompose iteration index into
(bi, si, d) while indexing into the underlying full-extent
buffer. n_total is the runtime-scaled iteration bound;
seq_stride is the compile-time-fixed full seq for stride.
seq_stride: u32§style: u32RoPE pairing flavor: 0 = NeoX rotate-half (i, i+half), 1 = GPT-J /
llama.cpp-NORM interleaved adjacent pairs (2i, 2i+1). GGUF Llama weights
are permuted for the GPT-J layout, so GGUF-backed decode needs style=1.
rot_half: u32Partial rotary: half of n_rot (the rotated width). Dims [n_rot, head_dim) are copied through unchanged. Equals half for full rotation
(n_rot == head_dim); smaller for p-RoPE (Gemma 4 global layers). The
cos/sin row stride stays half (head_dim/2), matching the CPU reference.
Trait Implementations§
Source§impl Clone for RopeParams
impl Clone for RopeParams
Source§fn clone(&self) -> RopeParams
fn clone(&self) -> RopeParams
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read moreimpl Copy for RopeParams
Source§impl Debug for RopeParams
impl Debug for RopeParams
impl Pod for RopeParams
Auto Trait Implementations§
impl Freeze for RopeParams
impl RefUnwindSafe for RopeParams
impl Send for RopeParams
impl Sync for RopeParams
impl Unpin for RopeParams
impl UnsafeUnpin for RopeParams
impl UnwindSafe for RopeParams
Blanket Implementations§
impl<T> AnyBitPattern for Twhere
T: Pod,
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<T> CheckedBitPattern for Twhere
T: AnyBitPattern,
impl<T> CheckedBitPattern for Twhere
T: AnyBitPattern,
Source§type Bits = T
type Bits = T
Self must have the same layout as the specified Bits except for
the possible invalid bit patterns being checked during
is_valid_bit_pattern.Source§fn is_valid_bit_pattern(_bits: &T) -> bool
fn is_valid_bit_pattern(_bits: &T) -> bool
bits
as &Self.Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more