Enum InferenceTarget 

pub enum InferenceTarget {
    None,
    Local(u16),
    Remote(PublicKey),
}

The current inference target selected by runtime planning.

Variants

None

No backend running anywhere.

Local(u16)

This node serves the model on the given local HTTP port.

Remote(PublicKey)

Another node serves the model; proxy via QUIC to this peer.

Trait Implementations

impl Clone for InferenceTarget

fn clone(&self) -> InferenceTarget

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceTarget

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Hash for InferenceTarget

fn hash<__H>(&self, state: &mut __H)

where __H: Hasher,

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for InferenceTarget

fn eq(&self, other: &InferenceTarget) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for InferenceTarget

impl StructuralPartialEq for InferenceTarget