Skip to main content

BidPreference

Struct BidPreference 

Source
pub struct BidPreference;
Expand description

The bid preference numbers runtime adapters use to compete for a model. Lower wins. This is the single global ordering; adapters must not mint their own.

Implementations§

Source§

impl BidPreference

Source

pub const LLAMA_CPP: i64 = 10

llama.cpp GGUF text runtime.

Source

pub const WHISPER_CPP: i64 = 10

whisper.cpp transcription runtime.

Source

pub const ENDPOINT: i64 = 10

OpenAI-compatible remote endpoint.

Source

pub const MLX_VLM: i64 = 14

mlx-vlm vision-language sidecar.

Source

pub const MLX_SWIFT: i64 = 15

in-process MLX-Swift text runtime.

Source

pub const APPLE_FOUNDATION: i64 = 15

Apple Foundation Models.

Source

pub const OLLAMA: i64 = 20

Ollama daemon.

Source

pub const MFLUX: i64 = 25

mflux FLUX image runtime.

Source

pub const DIFFUSERS: i64 = 26

diffusers image runtime.

Source

pub const COMFY_UI: i64 = 27

ComfyUI daemon.

Source

pub const A1111: i64 = 28

Automatic1111 daemon.

Source

pub const MLX_AUDIO: i64 = 30

mlx-audio speech runtime.

Source

pub const EMBEDDINGS: i64 = 32

embeddings sidecar.

Source

pub const MLX_LM: i64 = 40

mlx-lm text sidecar.

Source

pub const MANIFEST: i64 = 100

Manifest-declared runtime (lowest priority).

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.