Enum LlamaLoadMode 

#[repr(i32)]
pub enum LlamaLoadMode {
    Auto = -1,
    None = 0,
    Mmap = 1,
    Mlock = 2,
    MmapMlock = 3,
    DirectIo = 4,
}

Exact model-file loading strategy exposed by llama.cpp.

llama_load_mode is a signed enum on every target because of the negative LLAMA_LOAD_MODE_AUTO discriminant, so each variant uses as _ to coerce to the #[repr(i32)] type (matching token_type).

Variants

Auto = -1

Pick the strategy from the backend devices’ capabilities: memory-map when every device supports it, otherwise fall back to a plain read. This is llama.cpp’s default.

None = 0

No memory mapping, locking, or direct I/O.

Mmap = 1

Memory-map model files when supported.

Mlock = 2

Read model files normally and lock loaded pages in memory.

MmapMlock = 3

Memory-map model files and lock mapped pages in memory.

DirectIo = 4

Use direct I/O when supported.

Trait Implementations

impl Clone for LlamaLoadMode

fn clone(&self) -> LlamaLoadMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for LlamaLoadMode

impl Debug for LlamaLoadMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for LlamaLoadMode

impl PartialEq for LlamaLoadMode

fn eq(&self, other: &LlamaLoadMode) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for LlamaLoadMode