Struct BertEmbeddingsOnly 

pub struct BertEmbeddingsOnly {
    pub hidden: usize,
    /* private fields */
}

BERT’s embedding table on its own (word + position + token-type, then LayerNorm) — the reference uses BertModel.from_pretrained(base).embeddings and discards the encoder entirely. candle keeps its BertEmbeddings private, so this is implemented directly, which also lets it load the checkpoint’s bert.embeddings.* tensors verbatim.

Fields

hidden: usize

Implementations

impl BertEmbeddingsOnly

pub fn load( vb: VarBuilder<'_>, vocab: usize, max_pos: usize, type_vocab: usize, hidden: usize, ) -> Result<Self>

pub fn forward(&self, ids: &Tensor) -> Result<Tensor>

ids [B,T] → [B,T,h].