pub struct BoundedAttnCfg<'a> {
pub num_heads: usize,
pub num_kv_heads: usize,
pub head_dim: usize,
pub hidden_size: usize,
pub scale: f32,
pub rope: &'a BoundedRope,
pub pool: Option<&'a Pool>,
}Expand description
Per-token configuration of a bounded layer (geometry + the shared rotation table). No position: the operator has none.
Fields§
§num_heads: usize§num_kv_heads: usize§head_dim: usize§scale: f32Score scale (1/√hd unless the arch overrides).
rope: &'a BoundedRope§pool: Option<&'a Pool>Auto Trait Implementations§
impl<'a> !RefUnwindSafe for BoundedAttnCfg<'a>
impl<'a> !UnwindSafe for BoundedAttnCfg<'a>
impl<'a> Freeze for BoundedAttnCfg<'a>
impl<'a> Send for BoundedAttnCfg<'a>
impl<'a> Sync for BoundedAttnCfg<'a>
impl<'a> Unpin for BoundedAttnCfg<'a>
impl<'a> UnsafeUnpin for BoundedAttnCfg<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more