Enum NumaStrategy 

pub enum NumaStrategy {
    DISABLED,
    DISTRIBUTE,
    ISOLATE,
    NUMACTL,
    MIRROR,
    COUNT,
}

A rusty wrapper around numa_strategy.

Description

Represents different NUMA (Non-Uniform Memory Access) strategies for memory management in multi-core or multi-processor systems.

See more

https://github.com/ggerganov/llama.cpp/blob/master/ggml/include/ggml-cpu.h#L25-L32

Variants

DISABLED

The NUMA strategy is disabled. No NUMA-aware optimizations are applied. Memory allocation will not consider NUMA node locality.

DISTRIBUTE

Distribute memory across NUMA nodes. This strategy aims to balance memory usage across all available NUMA nodes, potentially improving load balancing and preventing memory hotspots on a single node. It may use round-robin or another method to distribute allocations.

ISOLATE

Isolate memory to specific NUMA nodes. Memory allocations will be restricted to specific NUMA nodes, potentially reducing contention and improving locality for processes or threads bound to a particular node.

NUMACTL

Use numactl to manage memory and processor affinities. This strategy utilizes the numactl command or library to bind processes or memory allocations to specific NUMA nodes or CPUs, providing fine-grained control over memory placement.

MIRROR

Mirror memory across NUMA nodes. This strategy creates duplicate memory copies on multiple NUMA nodes, which can help with fault tolerance and redundancy, ensuring that each NUMA node has access to a copy of the memory.

COUNT

A placeholder representing the total number of strategies available. Typically used for iteration or determining the number of strategies in the enum.

Trait Implementations

impl Clone for NumaStrategy

fn clone(&self) -> NumaStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for NumaStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<NumaStrategy> for ggml_numa_strategy

fn from(value: NumaStrategy) -> Self

Converts to this type from the input type.

impl PartialEq for NumaStrategy

fn eq(&self, other: &NumaStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl TryFrom<u32> for NumaStrategy

type Error = InvalidNumaStrategy

The type returned in the event of a conversion error.

fn try_from(value: ggml_numa_strategy) -> Result<Self, Self::Error>

Performs the conversion.

impl Copy for NumaStrategy

impl Eq for NumaStrategy

impl StructuralPartialEq for NumaStrategy