pub struct LinearAttnConfig {
pub layer_types: Vec<String>,
pub conv_kernel_dim: usize,
pub num_key_heads: usize,
pub key_head_dim: usize,
pub num_value_heads: usize,
pub value_head_dim: usize,
}Expand description
Configuration for linear (recurrent) attention layers (e.g. Gated DeltaNet in Qwen3.5).
Fields§
§layer_types: Vec<String>Per-layer type: “linear_attention” or “full_attention”.
conv_kernel_dim: usizeConv1d kernel size for short convolution preprocessing.
num_key_heads: usizeNumber of key heads in linear attention.
key_head_dim: usizePer-head key dimension in linear attention.
num_value_heads: usizeNumber of value heads in linear attention.
value_head_dim: usizePer-head value dimension in linear attention.
Trait Implementations§
Source§impl Clone for LinearAttnConfig
impl Clone for LinearAttnConfig
Source§fn clone(&self) -> LinearAttnConfig
fn clone(&self) -> LinearAttnConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for LinearAttnConfig
impl RefUnwindSafe for LinearAttnConfig
impl Send for LinearAttnConfig
impl Sync for LinearAttnConfig
impl Unpin for LinearAttnConfig
impl UnsafeUnpin for LinearAttnConfig
impl UnwindSafe for LinearAttnConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more