Enum LlamaSplitMode 

#[repr(i8)]
pub enum LlamaSplitMode {
    None = 0,
    Layer = 1,
    Row = 2,
}

A rusty wrapper around llama_split_mode.

Variants

None = 0

Single GPU

Layer = 1

Split layers and KV across GPUs

Row = 2

Split layers and KV across GPUs, use tensor parallelism if supported

Trait Implementations

impl Clone for LlamaSplitMode

fn clone(&self) -> LlamaSplitMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaSplitMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for LlamaSplitMode

The default split mode is Layer in llama.cpp.

fn default() -> LlamaSplitMode

Returns the “default value” for a type.

impl From<LlamaCppSplitMode> for LlamaSplitMode

fn from(value: LlamaCppSplitMode) -> Self

Converts to this type from the input type.

impl PartialEq for LlamaSplitMode

fn eq(&self, other: &LlamaSplitMode) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl TryFrom<i32> for LlamaSplitMode

Create a LlamaSplitMode from a i32.

Errors

Returns LlamaSplitModeParseError if the value does not correspond to a valid LlamaSplitMode.

type Error = LlamaSplitModeParseError

The type returned in the event of a conversion error.

fn try_from( value: i32, ) -> Result<LlamaSplitMode, <LlamaSplitMode as TryFrom<i32>>::Error>

Performs the conversion.

impl TryFrom<u32> for LlamaSplitMode

Create a LlamaSplitMode from a u32.

Errors

Returns LlamaSplitModeParseError if the value does not correspond to a valid LlamaSplitMode.

type Error = LlamaSplitModeParseError

The type returned in the event of a conversion error.

fn try_from( value: u32, ) -> Result<LlamaSplitMode, <LlamaSplitMode as TryFrom<u32>>::Error>

Performs the conversion.

impl Copy for LlamaSplitMode

impl Eq for LlamaSplitMode

impl StructuralPartialEq for LlamaSplitMode