Struct TrunkLayers 

pub struct TrunkLayers {
    pub block_count: usize,
    pub n_layers: usize,
    pub n_mtp_blocks: usize,
}

How many of a file’s blocks are decoder layers.

block_count is llama.cpp’s n_layer_all; n_layers its n_layer(); n_mtp_blocks its n_layer_nextn. The three are carried together because two of them are what every array-length check and every layer loop must NOT be handed interchangeably.

Fields

block_count: usize

{arch}.block_count, every block in the file.

n_layers: usize

The blocks that are decoder layers: block_count - n_mtp_blocks.

n_mtp_blocks: usize

{arch}.nextn_predict_layers where the architecture reads it, else 0.

Implementations

impl TrunkLayers

pub fn all(block_count: usize) -> Self

The whole file is trunk.

Trait Implementations

impl Clone for TrunkLayers

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TrunkLayers

impl Debug for TrunkLayers

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for TrunkLayers

impl PartialEq for TrunkLayers

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TrunkLayers