Struct llm_llama::Hyperparameters

pub struct Hyperparameters {
    pub n_vocab: usize,
    pub n_embd: usize,
    pub n_mult: usize,
    pub n_head: usize,
    pub n_layer: usize,
    pub n_rot: usize,
    pub file_type: FileType,
}

LLaMA hyperparameters

Fields

n_vocab: usize

Size of the model’s vocabulary

n_embd: usize

Size of the model’s embedding layer

n_mult: usize

n_mult

n_head: usize

n_head

n_layer: usize

Number of layers in the model

n_rot: usize

n_rot

file_type: FileType

file_type

Trait Implementations

impl Clone for Hyperparameters

fn clone(&self) -> Hyperparameters

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Hyperparameters

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Hyperparameters

fn default() -> Hyperparameters

Returns the “default value” for a type.

impl Hyperparameters for Hyperparameters

fn read_ggml(reader: &mut dyn BufRead) -> Result<Self, LoadError>

Read the parameters in GGML format from a reader.

fn write_ggml( &self, writer: &mut dyn Write ) -> Result<(), HyperparametersWriteError>

Write the parameters in GGML format to a writer.

fn n_vocabulary(&self) -> usize

Get the number of tokens in the vocabulary.

impl PartialEq<Hyperparameters> for Hyperparameters

fn eq(&self, other: &Hyperparameters) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Hyperparameters

impl Eq for Hyperparameters

impl StructuralEq for Hyperparameters

impl StructuralPartialEq for Hyperparameters