Struct MPNetEmbeddings

pub struct MPNetEmbeddings {
    pub padding_idx: u32,
    /* private fields */
}

Fields

padding_idx: u32

Implementations

impl MPNetEmbeddings

pub fn load(vb: VarBuilder<'_>, config: &MPNetConfig) -> Result<Self>

Loads the MPNetEmbeddings from the given VarBuilder and MPNetConfig.

Arguments

• vb - A VarBuilder used to construct the embeddings.
• config - The MPNetConfig that holds the configuration for the embeddings.

Returns

• Self - The constructed MPNetEmbeddings.

pub fn forward( &self, input_ids: &Tensor, position_ids: Option<&Tensor>, inputs_embeds: Option<&Tensor>, is_train: bool, ) -> Result<Tensor>

Performs a forward pass of the MPNetEmbeddings.

Arguments

• input_ids - The input tensor.
• position_ids - The position ids tensor.
• inputs_embeds - The inputs embeddings tensor.
• is_train - A boolean indicating whether the model is in training mode.

Returns

• Tensor - The result tensor after the forward pass.

pub fn create_position_ids_from_input_embeds( &self, input_embeds: &Tensor, ) -> Result<Tensor>

Creates position ids from the input embeddings.

Arguments

• input_embeds - The input embeddings tensor.

Returns

• Tensor - The position ids tensor.