pub struct BlockResidualWeights {
pub self_attention_res_norm_weight: Vec<f32>,
pub self_attention_res_proj_weight: Vec<f32>,
pub mlp_res_norm_weight: Vec<f32>,
pub mlp_res_proj_weight: Vec<f32>,
}Expand description
The four block-residual weight vectors real Kimi K3 attaches to
every layer ({prefix}.self_attention_res_{norm,proj}.weight,
{prefix}.mlp_res_{norm,proj}.weight). Real on-disk *_proj.weight
shape is [1, hidden_dim] (a Linear(hidden_dim, 1)’s weight); the
raw bytes are already exactly [hidden_dim] flattened.
Fields§
§self_attention_res_norm_weight: Vec<f32>§self_attention_res_proj_weight: Vec<f32>§mlp_res_norm_weight: Vec<f32>§mlp_res_proj_weight: Vec<f32>Auto Trait Implementations§
impl Freeze for BlockResidualWeights
impl RefUnwindSafe for BlockResidualWeights
impl Send for BlockResidualWeights
impl Sync for BlockResidualWeights
impl Unpin for BlockResidualWeights
impl UnsafeUnpin for BlockResidualWeights
impl UnwindSafe for BlockResidualWeights
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more