Enum BackendKind 

pub enum BackendKind {
    Ollama,
    Openai,
    Embedded,
}

The wire protocol an inference backend speaks.

Variants

Ollama

Ollama’s native POST /api/chat API (the historical default).

Openai

An OpenAI-compatible HTTP API (POST /v1/chat/completions, GET /v1/models): vLLM, llama.cpp’s server, or any hosted OpenAI-compatible endpoint. Optionally authenticated with a bearer token (see BackendConfig::api_key_file / BackendConfig::api_key_env).

Embedded

An in-process inference backend — no HTTP, no external server. Loads a small quantized (GGUF) model and runs it in-tree (Metal-accelerated on Apple Silicon). Opt-in behind the embedded cargo feature (default-off); when the feature is absent, selecting it is a clear build-time-off error, never a silent fallback. Intended for the summarizer + small auxiliary calls so they never contend with the primary model (#639).

Implementations

impl BackendKind

pub fn label(self) -> &'static str

Short human label for the wire protocol — shown in the ready preamble and the /backends list. Note newt models the protocol, so vLLM, llama.cpp, and hosted OpenAI all read as openai (vLLM has no distinct wire form).

Trait Implementations

impl Clone for BackendKind

fn clone(&self) -> BackendKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for BackendKind

impl Debug for BackendKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for BackendKind

fn default() -> BackendKind

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for BackendKind

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for BackendKind

impl PartialEq for BackendKind

fn eq(&self, other: &BackendKind) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for BackendKind

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for BackendKind