pub struct Geometry {Show 20 fields
pub hidden: usize,
pub intermediate: usize,
pub layers: usize,
pub heads: usize,
pub kv_heads: usize,
pub head_dim: usize,
pub vocab: usize,
pub block: usize,
pub mask_token: u32,
pub conv_group: usize,
pub conv_kernel: usize,
pub selector_rank: usize,
pub selector_top: usize,
pub taps: Vec<usize>,
pub target_layers: usize,
pub window: usize,
pub windows: Vec<usize>,
pub no_rope: Vec<usize>,
pub rope_theta: f64,
pub eps: f64,
}Expand description
What a DFlash 2 checkpoint’s config fixes.
Fields§
§intermediate: usize§layers: usize§heads: usize§kv_heads: usize§head_dim: usize§vocab: usize§block: usizeRows of a block: the anchor and block − 1 drafts.
mask_token: u32§conv_group: usize§conv_kernel: usize§selector_rank: usize§selector_top: usize§taps: Vec<usize>The target’s layers whose outputs a context row joins, zero-based:
the output of layer id, before any norm.
target_layers: usize§window: usizePositions a block row sees back; 0 is all of them.
windows: Vec<usize>The same per layer where the layers differ (a full-attention layer
among sliding ones: 0). Empty: window for every layer.
no_rope: Vec<usize>Layers whose queries and keys carry no rotary position.
rope_theta: f64§eps: f64Implementations§
Trait Implementations§
Source§impl<'de> Deserialize<'de> for Geometry
impl<'de> Deserialize<'de> for Geometry
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl StructuralPartialEq for Geometry
Auto Trait Implementations§
impl Forget for Geometry
impl Freeze for Geometry
impl Move for Geometry
impl RefUnwindSafe for Geometry
impl Send for Geometry
impl Sync for Geometry
impl Unpin for Geometry
impl UnsafeUnpin for Geometry
impl UnwindSafe for Geometry
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more