Enum SharingStrategy 

pub enum SharingStrategy {
    HardSharing {
        shared_layers: usize,
        task_specific_layers: Vec<usize>,
    },
    SoftSharing {
        l2_penalty: f64,
        similarity_threshold: f64,
    },
    CrossStitch {
        num_units: Vec<usize>,
    },
    AttentionSharing {
        attention_dim: usize,
    },
}

Multi-task learning strategies for parameter sharing

Variants

HardSharing

Hard parameter sharing: shared backbone, task-specific heads

Fields

shared_layers: usize

Number of shared bottom layers before task-specific heads branch off

task_specific_layers: Vec<usize>

Sizes (number of neurons) of each task-specific layer after the shared trunk

SoftSharing

Soft parameter sharing: task-specific networks with regularization

Fields

l2_penalty: f64

L2 penalty encouraging the task-specific weight matrices to remain similar

similarity_threshold: f64

Cosine similarity threshold below which the penalty is applied more aggressively

CrossStitch

Cross-stitch networks: linear combinations of task-specific features

Fields

num_units: Vec<usize>

Number of units in each cross-stitch layer

AttentionSharing

Attention-based sharing: learn what to share between tasks

Fields

attention_dim: usize

Dimensionality of the attention keys and queries used for sharing decisions

Trait Implementations

impl Clone for SharingStrategy

fn clone(&self) -> SharingStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SharingStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SharingStrategy

fn default() -> Self

Returns the “default value” for a type.

impl PartialEq for SharingStrategy

fn eq(&self, other: &SharingStrategy) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for SharingStrategy