Enum LlmBackend 

pub enum LlmBackend {
    Mock,
    Ollama {
        base_url: String,
        model: String,
    },
    OpenAiCompatible {
        base_url: String,
        api_key: String,
        model: String,
    },
    Anthropic {
        base_url: String,
        api_key: String,
        model: String,
    },
    Google {
        base_url: String,
        api_key: String,
        model: String,
    },
    Command {
        command: String,
        timeout_secs: u64,
    },
}

Which LLM backend the server uses for fact extraction.

Variants

Mock

Deterministic mock that always returns {"facts": []}. Use only for tests — memory_add will produce zero facts.

Ollama

Ollama-backed chat-completion client (local, free) — uses Ollama’s native /api/chat.

Fields

base_url: String

model: String

OpenAiCompatible

Any OpenAI chat-completions-compatible endpoint — OpenAI itself, Azure OpenAI, Groq, Together, Mistral, DeepSeek, Perplexity, OpenRouter, Fireworks, vLLM, LM Studio, LocalAI, or Ollama’s /v1 compat layer. Switch providers by changing base_url alone.

Fields

base_url: String

api_key: String

model: String

Anthropic

Anthropic Claude via the Messages API.

Fields

base_url: String

api_key: String

model: String

Google

Google Gemini via the generateContent API.

Fields

base_url: String

api_key: String

model: String

Command

Shell-out extensibility escape hatch. Runs a user-supplied command per extraction call, writes a JSON request to stdin, reads JSON from stdout. See engram::llm_command for the stdin/stdout contract.

Fields

command: String

timeout_secs: u64

Implementations

impl LlmBackend

pub fn build(&self) -> Box<dyn LlmClient>

Build a fresh boxed LLM client. Memory::add_messages takes Box<dyn LlmClient> by value, so each extraction call needs its own.

pub fn describe(&self) -> String

Human-readable description for startup logs. Never includes API keys or command contents longer than 60 characters.

Trait Implementations

impl Clone for LlmBackend

fn clone(&self) -> LlmBackend

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmBackend

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.