pub enum InferenceBackend {
CandleCpu,
CandleCuda,
OnnxRuntime,
Mock,
}Expand description
The compute backend used for local inference.
Note (RFC-046): CandleCpu and CandleCuda are not currently
supported. The orbok-embed factory routes them to a not-supported
error; no Candle backend is implemented. These variants are retained for
model-layer/API stability. A future backend-API RFC may revisit them
(e.g. reintroduce a Candle backend, or remove the variants under a
deprecation policy). They are intentionally not #[deprecated] yet.
Variants§
CandleCpu
CPU-only inference via candle. Not currently supported (RFC-046).
CandleCuda
GPU inference via candle + CUDA. Not currently supported (RFC-046).
OnnxRuntime
ONNX Runtime (CPU or GPU via execution provider).
Mock
Mock backend for tests — deterministic, no model files.
Implementations§
Trait Implementations§
Source§impl Clone for InferenceBackend
impl Clone for InferenceBackend
Source§fn clone(&self) -> InferenceBackend
fn clone(&self) -> InferenceBackend
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for InferenceBackend
impl Debug for InferenceBackend
impl Eq for InferenceBackend
Source§impl PartialEq for InferenceBackend
impl PartialEq for InferenceBackend
Source§fn eq(&self, other: &InferenceBackend) -> bool
fn eq(&self, other: &InferenceBackend) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for InferenceBackend
Auto Trait Implementations§
impl Freeze for InferenceBackend
impl RefUnwindSafe for InferenceBackend
impl Send for InferenceBackend
impl Sync for InferenceBackend
impl Unpin for InferenceBackend
impl UnsafeUnpin for InferenceBackend
impl UnwindSafe for InferenceBackend
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more