Struct ScalarWeightClassifier

pub struct ScalarWeightClassifier { /* private fields */ }

A classifier that uses scalar weighting of layers.

See Peters et al., 2018 and Kondratyuk & Straka, 2019.

Implementations

impl ScalarWeightClassifier

pub fn new<'a>( vs: impl Borrow<PathExt<'a>>, config: &ScalarWeightClassifierConfig, ) -> Result<ScalarWeightClassifier, TransformerError>

pub fn forward( &self, layers: &[LayerOutput], train: bool, ) -> Result<Tensor, TransformerError>

pub fn logits( &self, layers: &[LayerOutput], train: bool, ) -> Result<Tensor, TransformerError>

pub fn losses( &self, layers: &[LayerOutput], targets: &Tensor, label_smoothing: Option<f64>, train: bool, ) -> Result<(Tensor, Tensor), TransformerError>

Compute the losses and correctly predicted labels of the given targets.

targets should be of the shape [batch_size, seq_len].

Trait Implementations

impl Debug for ScalarWeightClassifier

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.