Enum PruneGranularity 

pub enum PruneGranularity {
    Channel {
        n_out: usize,
        n_in: usize,
    },
    Filter {
        n_filters: usize,
        filter_size: usize,
    },
    Head {
        n_heads: usize,
        head_dim: usize,
    },
}

Structural unit to remove during pruning.

Variants

Channel

Prune entire output channels (rows) of a weight matrix [n_out, n_in].

Fields

n_out: usize

Number of output channels (rows of the weight matrix).

n_in: usize

Number of input channels (columns of the weight matrix).

Filter

Prune entire convolutional filters, each of length filter_size.

Fields

n_filters: usize

Number of filters (= output channels for a conv layer).

filter_size: usize

Flattened size of each filter (in_channels × kH × kW).

Head

Prune entire attention heads in a projection matrix.

Fields

n_heads: usize

Number of attention heads.

head_dim: usize

Dimension per head.

Trait Implementations

impl Clone for PruneGranularity

fn clone(&self) -> PruneGranularity

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PruneGranularity

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for PruneGranularity

fn eq(&self, other: &PruneGranularity) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for PruneGranularity

impl Eq for PruneGranularity

impl StructuralPartialEq for PruneGranularity