Struct syntaxdot_transformers::layers::VariationalDropout

pub struct VariationalDropout { /* private fields */ }

Variational dropout (Gal and Ghahramani, 2016)

For a tensor with [batch_size, seq_len, repr_size], apply the same dropout [batch_size, 1, repr_size] to each sequence element.

Implementations

impl VariationalDropout

pub fn new(p: f64) -> Self

Create a variational dropout layer with the given dropout probability.

Trait Implementations

impl Debug for VariationalDropout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl FallibleModuleT for VariationalDropout

type Error = TransformerError

The error type.

fn forward_t(&self, xs: &Tensor, train: bool) -> Result<Tensor, Self::Error>

Apply the module.