pub enum SubRoute {
HFInference,
Together,
SambaNova,
Fireworks,
Hyperbolic,
Nebius,
Novita,
Custom(String),
}Expand description
Backend selected through the Hugging Face router.
Variants§
HFInference
Hugging Face’s own inference backend: the only one that serves transcription and image generation.
Together
Together AI, through the router.
SambaNova
SambaNova, through the router.
Fireworks
Fireworks AI, which addresses models by a qualified id.
Hyperbolic
Hyperbolic, through the router.
Nebius
Nebius, through the router.
Novita
Novita, through the router.
Custom(String)
A route this build does not name.
Implementations§
Source§impl SubRoute
impl SubRoute
Sourcepub fn model_identifier(&self, model: &str) -> String
pub fn model_identifier(&self, model: &str) -> String
Qualify Fireworks model identifiers unless already prefixed. Return other sub-routes’ identifiers unchanged.
Sourcepub fn serves_model_routed_endpoints(&self) -> bool
pub fn serves_model_routed_endpoints(&self) -> bool
Whether this sub-provider serves the endpoints that address the model through the URL (transcription, image generation).
Trait Implementations§
Source§impl<'de> Deserialize<'de> for SubRoute
impl<'de> Deserialize<'de> for SubRoute
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for SubRoute
impl StructuralPartialEq for SubRoute
Auto Trait Implementations§
impl Freeze for SubRoute
impl RefUnwindSafe for SubRoute
impl Send for SubRoute
impl Sync for SubRoute
impl Unpin for SubRoute
impl UnsafeUnpin for SubRoute
impl UnwindSafe for SubRoute
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
impl<T> IntoToolOutput for Twhere
T: Serialize + 'static,
Source§fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
fn into_tool_output(self) -> Result<ToolOutput, ToolExecutionError>
Convert this value without routing structured data through a string.
Source§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<T> ToStringFallible for Twhere
T: Display,
impl<T> ToStringFallible for Twhere
T: Display,
Source§fn try_to_string(&self) -> Result<String, TryReserveError>
fn try_to_string(&self) -> Result<String, TryReserveError>
ToString::to_string, but without panic on OOM.