Struct LlamaBackend 

pub struct LlamaBackend { /* private fields */ }

RAII proof that the ik_llama.cpp backend has been initialized.

Initialization is a process-wide singleton (like llama.cpp itself). Hold one LlamaBackend for the lifetime of your models/contexts; dropping it calls llama_backend_free.

Implementations

impl LlamaBackend

pub fn init() -> Result<Self, LlamaError>

Initialize the backend. Returns LlamaError::BackendAlreadyInitialized if a LlamaBackend is already live in this process.

Trait Implementations

impl Debug for LlamaBackend

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for LlamaBackend

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.