Struct StateKnockoutSpec 

pub struct StateKnockoutSpec {
    pub positions: Vec<usize>,
    pub layers: LayerSpec,
}

Specification for RWKV-6 state knockout intervention.

State knockout makes specific token positions invisible to all future tokens by skipping the recurrent state update at those positions. This is the RNN analogue of all-edge attention knockout in transformers.

Fields

positions: Vec<usize>

Token positions where state update is skipped.

layers: LayerSpec

Which layers to apply knockout.

Implementations

impl StateKnockoutSpec

pub const fn new() -> Self

Create a new empty spec (all layers, no positions yet).

pub fn position(self, pos: usize) -> Self

Add a single position to knock out.

pub fn positions(self, positions: &[usize]) -> Self

Add multiple positions to knock out.

pub fn layer(self, layer: usize) -> Self

Target a single layer.

pub fn layers(self, layers: &[usize]) -> Self

Target multiple specific layers.

pub fn layer_range(self, start: usize, end: usize) -> Self

Target a range of layers (inclusive).

pub fn applies_to_layer(&self, layer: usize) -> bool

Check if knockout applies to this layer.

pub fn position_set(&self) -> HashSet<usize>

Get knockout positions as a HashSet for O(1) lookup in the WKV loop.

pub fn validate(&self, n_layers: usize, seq_len: usize) -> Result<()>

Validate the spec against model dimensions.

Errors

Returns MIError::Intervention if positions, layers are out of range, or no positions are specified.

Trait Implementations

impl Clone for StateKnockoutSpec

fn clone(&self) -> StateKnockoutSpec

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for StateKnockoutSpec

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for StateKnockoutSpec

fn default() -> Self

Returns the “default value” for a type.