pub enum EndpointKind {
Ollama,
OllamaLb,
InCluster,
Vllm,
}Expand description
The four endpoint flavors a DGX node can expose.
Variants§
Ollama
Direct DGX Ollama endpoint (typically Traefik-fronted HTTPS).
OllamaLb
Round-robin load balancer across Ollama backends.
InCluster
In-cluster, model-aware Ollama proxy (for pods).
Vllm
vLLM OpenAI-compatible endpoint.
Implementations§
Source§impl EndpointKind
impl EndpointKind
Sourcepub fn url_env_var(self) -> &'static str
pub fn url_env_var(self) -> &'static str
The environment variable that overrides this flavor’s full URL.
Sourcepub fn is_openai_compatible(self) -> bool
pub fn is_openai_compatible(self) -> bool
Whether this flavor speaks the OpenAI-compatible (/v1) API. Only
vllm does; the rest speak Ollama’s native /api.
Trait Implementations§
Source§impl Clone for EndpointKind
impl Clone for EndpointKind
Source§fn clone(&self) -> EndpointKind
fn clone(&self) -> EndpointKind
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for EndpointKind
Source§impl Debug for EndpointKind
impl Debug for EndpointKind
Source§impl Default for EndpointKind
impl Default for EndpointKind
Source§fn default() -> EndpointKind
fn default() -> EndpointKind
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for EndpointKind
impl<'de> Deserialize<'de> for EndpointKind
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Display for EndpointKind
impl Display for EndpointKind
impl Eq for EndpointKind
Source§impl FromStr for EndpointKind
impl FromStr for EndpointKind
Source§impl Hash for EndpointKind
impl Hash for EndpointKind
Source§impl PartialEq for EndpointKind
impl PartialEq for EndpointKind
Source§impl Serialize for EndpointKind
impl Serialize for EndpointKind
impl StructuralPartialEq for EndpointKind
Auto Trait Implementations§
impl Freeze for EndpointKind
impl RefUnwindSafe for EndpointKind
impl Send for EndpointKind
impl Sync for EndpointKind
impl Unpin for EndpointKind
impl UnsafeUnpin for EndpointKind
impl UnwindSafe for EndpointKind
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
impl<T> ErasedDestructor for Twhere
T: 'static,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more