#[non_exhaustive]pub enum LLMProvider {
LiteLLM,
OpenRouter,
Ollama,
OpenAI,
Anthropic,
OpenAICompatible,
Azure,
}Expand description
LLM Provider type — determines which backend to use
§Stability
This enum is #[non_exhaustive] — new variants may be added in minor releases.
Match with a wildcard arm to handle future variants.
Variants (Non-exhaustive)§
This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
LiteLLM
OpenRouter
Ollama
OpenAI
Anthropic
OpenAICompatible
Generic OpenAI-compatible provider (vLLM, llama.cpp, LM Studio, TGI, Groq, Together AI, etc.)
Azure
Azure OpenAI Service
Trait Implementations§
Source§impl Clone for LLMProvider
impl Clone for LLMProvider
Source§fn clone(&self) -> LLMProvider
fn clone(&self) -> LLMProvider
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LLMProvider
impl Debug for LLMProvider
Source§impl Default for LLMProvider
impl Default for LLMProvider
Source§fn default() -> LLMProvider
fn default() -> LLMProvider
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for LLMProvider
impl<'de> Deserialize<'de> for LLMProvider
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for LLMProvider
impl PartialEq for LLMProvider
Source§fn eq(&self, other: &LLMProvider) -> bool
fn eq(&self, other: &LLMProvider) -> bool
Tests for
self and other values to be equal, and is used by ==.Source§impl Serialize for LLMProvider
impl Serialize for LLMProvider
impl StructuralPartialEq for LLMProvider
Auto Trait Implementations§
impl Freeze for LLMProvider
impl RefUnwindSafe for LLMProvider
impl Send for LLMProvider
impl Sync for LLMProvider
impl Unpin for LLMProvider
impl UnsafeUnpin for LLMProvider
impl UnwindSafe for LLMProvider
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request