Struct SqueezeBertEncoder

pub struct SqueezeBertEncoder { /* private fields */ }

SqueezeBERT encoder.

Even though SqueezeBERT uses [batch_size, hidden_size, seq_len] format internally, the encoder accepts the regular [batch_size, seq_len, hidden_size] format.

Implementations

impl SqueezeBertEncoder

pub fn new<'a>( vs: impl Borrow<PathExt<'a>>, config: &SqueezeBertConfig, ) -> Result<Self, TransformerError>

Trait Implementations

impl Debug for SqueezeBertEncoder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Encoder for SqueezeBertEncoder

fn encode( &self, input: &Tensor, attention_mask: Option<&Tensor>, train: bool, ) -> Result<Vec<LayerOutput>, TransformerError>

Apply the encoder.

fn n_layers(&self) -> i64

Get the number of layers that is returned by the encoder.