Struct BertHparams 

pub struct BertHparams {
    pub arch: String,
    pub n_layer: usize,
    pub n_embd: usize,
    pub n_ff: usize,
    pub n_head: usize,
    pub n_head_kv: usize,
    pub n_ctx_train: usize,
    pub n_token_types: usize,
    pub layer_norm_eps: f32,
    pub pooling: PoolingType,
    pub cls_id: u32,
    pub sep_id: u32,
}

bert.* metadata, after the loader has checked it.

Fields

arch: String

n_layer: usize

n_embd: usize

n_ff: usize

n_head: usize

n_head_kv: usize

n_ctx_train: usize

Height of the learned position table.

n_token_types: usize

layer_norm_eps: f32

pooling: PoolingType

cls_id: u32

[CLS] / [SEP], from tokenizer.ggml.bos_token_id and tokenizer.ggml.seperator_token_id (upstream’s spelling of the key, typo included). See BertEncoder::wrap_special.

sep_id: u32

Implementations

impl BertHparams

pub fn head_dim(&self) -> usize

Trait Implementations

impl Clone for BertHparams

fn clone(&self) -> BertHparams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for BertHparams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.