pub enum RopeStyle {
NeoX,
GptJ,
}Expand description
Pairing convention for Op::Rope. Different model families bake RoPE
into their weights differently, so the rotation kernel needs a flavor:
RopeStyle::NeoX(default): HF / GPT-NeoX “rotate-half” — dimensionipairs withi + n_rot/2. Used by HF-safetensors checkpoints (Llama, Qwen, Gemma, …).RopeStyle::GptJ: GPT-J / llama.cppNORM— adjacent pairs(2i, 2i+1). GGUF Llama weights are permuted by the HF→GGUF converter for this layout, so GGUF-backed Llama inference must rotate with this flavor.
Variants§
Trait Implementations§
impl Copy for RopeStyle
Source§impl<'de> Deserialize<'de> for RopeStyle
impl<'de> Deserialize<'de> for RopeStyle
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<RopeStyle, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<RopeStyle, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for RopeStyle
Source§impl Serialize for RopeStyle
impl Serialize for RopeStyle
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
impl StructuralPartialEq for RopeStyle
Auto Trait Implementations§
impl Freeze for RopeStyle
impl RefUnwindSafe for RopeStyle
impl Send for RopeStyle
impl Sync for RopeStyle
impl Unpin for RopeStyle
impl UnsafeUnpin for RopeStyle
impl UnwindSafe for RopeStyle
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more