pub struct BidPreference;Expand description
The bid preference numbers runtime adapters use to compete for a model. Lower wins. This is the single global ordering; adapters must not mint their own.
Implementations§
Source§impl BidPreference
impl BidPreference
Sourcepub const WHISPER_CPP: i64 = 10
pub const WHISPER_CPP: i64 = 10
whisper.cpp transcription runtime.
Sourcepub const APPLE_FOUNDATION: i64 = 15
pub const APPLE_FOUNDATION: i64 = 15
Apple Foundation Models.
Sourcepub const EMBEDDINGS: i64 = 32
pub const EMBEDDINGS: i64 = 32
embeddings sidecar.
Auto Trait Implementations§
impl Freeze for BidPreference
impl RefUnwindSafe for BidPreference
impl Send for BidPreference
impl Sync for BidPreference
impl Unpin for BidPreference
impl UnsafeUnpin for BidPreference
impl UnwindSafe for BidPreference
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more