Enum LlamaSplitMode 

#[repr(i8)]
pub enum LlamaSplitMode {
    None = 0,
    Layer = 1,
    Row = 2,
}

A rusty wrapper around llama_split_mode.

Variants

None = 0

Single GPU

Layer = 1

Split layers and KV across GPUs

Row = 2

Split layers and KV across GPUs, use tensor parallelism if supported

Trait Implementations

impl Clone for LlamaSplitMode

fn clone(&self) -> LlamaSplitMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaSplitMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LlamaSplitMode

The default split mode is Layer in llama.cpp.

fn default() -> Self

Returns the “default value” for a type.

impl From<LlamaSplitMode> for i32

Create a i32 from a LlamaSplitMode.

fn from(value: LlamaSplitMode) -> Self

Converts to this type from the input type.

impl From<LlamaSplitMode> for u32

Create a u32 from a LlamaSplitMode.

fn from(value: LlamaSplitMode) -> Self

Converts to this type from the input type.

impl PartialEq for LlamaSplitMode

fn eq(&self, other: &LlamaSplitMode) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl TryFrom<i32> for LlamaSplitMode

Create a LlamaSplitMode from a i32.

Errors

Returns LlamaSplitModeParseError if the value does not correspond to a valid LlamaSplitMode.

type Error = LlamaSplitModeParseError

The type returned in the event of a conversion error.

fn try_from(value: i32) -> Result<Self, Self::Error>

Performs the conversion.

impl TryFrom<u32> for LlamaSplitMode

Create a LlamaSplitMode from a u32.

Errors

Returns LlamaSplitModeParseError if the value does not correspond to a valid LlamaSplitMode.

type Error = LlamaSplitModeParseError

The type returned in the event of a conversion error.

fn try_from(value: u32) -> Result<Self, Self::Error>

Performs the conversion.

impl Copy for LlamaSplitMode

impl Eq for LlamaSplitMode

impl StructuralPartialEq for LlamaSplitMode