Struct AlbertEmbeddings

pub struct AlbertEmbeddings { /* private fields */ }

ALBERT embeddings.

These embeddings are the same as BERT embeddings. However, we do some wrapping to ensure that the right embedding dimensionality is used.

Implementations

impl AlbertEmbeddings

pub fn new<'a>( vs: impl Borrow<PathExt<'a>>, config: &AlbertConfig, ) -> Result<Self, TransformerError>

Construct new ALBERT embeddings with the given variable store and ALBERT configuration.

pub fn forward( &self, input_ids: &Tensor, token_type_ids: Option<&Tensor>, position_ids: Option<&Tensor>, train: bool, ) -> Result<Tensor, TransformerError>

Trait Implementations

impl Debug for AlbertEmbeddings

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl FallibleModuleT for AlbertEmbeddings

type Error = TransformerError

The error type.

fn forward_t(&self, input: &Tensor, train: bool) -> Result<Tensor, Self::Error>

Apply the module.