Enum InferFlavor 

pub enum InferFlavor {
    LlamaCpp,
    MlxLm,
    Ollama,
}

Which server software an adapter drives.

Variants

LlamaCpp

llama-server (OpenAI-compatible, GGUF), usually through serve-llamacpp.

MlxLm

mlx_lm.server (MLX quantisation directories), usually through serve.

Ollama

Ollama, which owns its own process and model load/unload.

Implementations

impl InferFlavor

pub fn id(self) -> &'static str

Runtime id (infer.llamacpp).

pub fn capability(self) -> &'static str

The capability a node advertises when this runtime works.

pub fn default_port(self) -> u16

Conventional port of a hand-started server. A default only: every test and every managed instance sets its own.

pub fn formats(self) -> &'static [&'static str]

format.* capability suffixes this runtime can load.

Trait Implementations

impl Clone for InferFlavor

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for InferFlavor

impl Debug for InferFlavor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for InferFlavor

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for InferFlavor

impl Hash for InferFlavor

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for InferFlavor

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for InferFlavor

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for InferFlavor