Struct syntaxdot_transformers::scalar_weighting::ScalarWeightClassifier

pub struct ScalarWeightClassifier { /* private fields */ }

A classifier that uses scalar weighting of layers.

See Peters et al., 2018 and Kondratyuk & Straka, 2019.

Implementations

impl ScalarWeightClassifier

pub fn new<'a>(
    vs: impl Borrow<PathExt<'a>>,
    config: &ScalarWeightClassifierConfig
) -> Result<ScalarWeightClassifier, TransformerError>

pub fn forward(
    &self,
    layers: &[LayerOutput],
    train: bool
) -> Result<Tensor, TransformerError>

pub fn logits(
    &self,
    layers: &[LayerOutput],
    train: bool
) -> Result<Tensor, TransformerError>

pub fn losses(
    &self,
    layers: &[LayerOutput],
    targets: &Tensor,
    label_smoothing: Option<f64>,
    train: bool
) -> Result<(Tensor, Tensor), TransformerError>

Compute the losses and correctly predicted labels of the given targets.

targets should be of the shape [batch_size, seq_len].

Trait Implementations

impl Debug for ScalarWeightClassifier

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.