pub enum Provider {
LMStudio,
Ollama,
LlamaCpp,
VLLM,
}Expand description
Local inference providers with conventional OpenAI-compatible endpoint URLs.
Variants§
LMStudio
LM Studio - Popular GUI-based local model server (default port 1234)
Ollama
Ollama - Command-line focused local model server (default port 11434)
LlamaCpp
llama.cpp - C++ inference engine with server mode (default port 8080)
VLLM
vLLM - High-performance inference server (default port 8000)
Implementations§
Trait Implementations§
impl Copy for Provider
impl Eq for Provider
Source§impl FromStr for Provider
impl FromStr for Provider
impl StructuralPartialEq for Provider
Auto Trait Implementations§
impl Freeze for Provider
impl RefUnwindSafe for Provider
impl Send for Provider
impl Sync for Provider
impl Unpin for Provider
impl UnsafeUnpin for Provider
impl UnwindSafe for Provider
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.