Skip to main content

AnyClient

Enum AnyClient 

Source
pub enum AnyClient {
    OpenAI(OpenAIClient),
    Anthropic(AnthropicClient),
    Grok(GrokClient),
    Gemini(GeminiClient),
}
Expand description

A provider-agnostic client chosen at runtime.

Because LLMClient has a generic materialize method it is not object-safe, so Box<dyn LLMClient> is impossible. AnyClient is an enum over the concrete clients that itself implements LLMClient, giving you a single, Clone, Send + Sync type that can hold whichever provider you selected at runtime (from a CLI flag, config file, env, etc.).

Construct it with from_env_for, with LLMClient::from_env (which auto-detects from the environment), or with From<ConcreteClient> when you need custom configuration:

use rstructor::{AnyClient, Provider, LLMClient, Instructor};
use serde::{Serialize, Deserialize};

#[derive(Instructor, Serialize, Deserialize, Debug)]
struct Movie {
    title: String,
}

// Provider decided at runtime.
let provider = Provider::Anthropic;
let client = AnyClient::from_env_for(provider)?;

let movie: Movie = client.materialize("Describe Inception").await?;
println!("{}", movie.title);

Wrapping a pre-configured client:

use rstructor::{AnyClient, OpenAIClient, OpenAIModel};

let configured = OpenAIClient::from_env()?.model(OpenAIModel::Gpt55);
let client: AnyClient = configured.into();

Variants§

§

OpenAI(OpenAIClient)

An OpenAI client.

§

Anthropic(AnthropicClient)

An Anthropic client.

§

Grok(GrokClient)

A Grok client.

§

Gemini(GeminiClient)

A Gemini client.

Implementations§

Source§

impl AnyClient

Source

pub fn from_env_for(provider: Provider) -> Result<Self>

Build a client for provider, reading its API key from the environment.

§Errors

Returns an error if the provider’s environment variable is not set.

Source

pub fn provider(&self) -> Provider

Return the Provider backing this client.

Trait Implementations§

Source§

impl Clone for AnyClient

Source§

fn clone(&self) -> AnyClient

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl From<AnthropicClient> for AnyClient

Available on crate feature anthropic only.
Source§

fn from(client: AnthropicClient) -> Self

Converts to this type from the input type.
Source§

impl From<GeminiClient> for AnyClient

Available on crate feature gemini only.
Source§

fn from(client: GeminiClient) -> Self

Converts to this type from the input type.
Source§

impl From<GrokClient> for AnyClient

Available on crate feature grok only.
Source§

fn from(client: GrokClient) -> Self

Converts to this type from the input type.
Source§

impl From<OpenAIClient> for AnyClient

Available on crate feature openai only.
Source§

fn from(client: OpenAIClient) -> Self

Converts to this type from the input type.
Source§

impl LLMClient for AnyClient

Source§

fn from_env() -> Result<Self>

Auto-detect a provider from the environment.

Enabled providers are tried in order (OpenAI, Anthropic, Grok, Gemini) and the first one whose API-key variable is set is used. For deterministic selection, prefer AnyClient::from_env_for.

§Errors

Returns an ApiErrorKind::AuthenticationFailed error if none of the enabled providers’ API-key variables are set.

Source§

fn materialize<'life0, 'life1, 'async_trait, T>( &'life0 self, prompt: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<T>> + Send + 'async_trait>>
where T: Instructor + DeserializeOwned + Send + 'static + 'async_trait, Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Materialize a structured object of type T from a prompt. Read more
Source§

fn materialize_with_media<'life0, 'life1, 'life2, 'async_trait, T>( &'life0 self, prompt: &'life1 str, media: &'life2 [MediaFile], ) -> Pin<Box<dyn Future<Output = Result<T>> + Send + 'async_trait>>
where T: Instructor + DeserializeOwned + Send + 'static + 'async_trait, Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Materialize a structured object with media references (if supported). Read more
Source§

fn materialize_with_metadata<'life0, 'life1, 'async_trait, T>( &'life0 self, prompt: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<MaterializeResult<T>>> + Send + 'async_trait>>
where T: Instructor + DeserializeOwned + Send + 'static + 'async_trait, Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Materialize a structured object with metadata (token usage). Read more
Source§

fn generate<'life0, 'life1, 'async_trait>( &'life0 self, prompt: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<String>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Raw completion without structure (returns plain text). Read more
Source§

fn generate_with_media<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, prompt: &'life1 str, media: &'life2 [MediaFile], ) -> Pin<Box<dyn Future<Output = Result<String>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Raw text completion with media attachments (if supported). Read more
Source§

fn generate_with_metadata<'life0, 'life1, 'async_trait>( &'life0 self, prompt: &'life1 str, ) -> Pin<Box<dyn Future<Output = Result<GenerateResult>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Raw completion with metadata (token usage). Read more
Source§

fn list_models<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<Vec<ModelInfo>>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait,

Fetch available models from the provider’s API. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<C> RequestExt for C
where C: LLMClient + ?Sized,

Source§

fn request(&self) -> Request<'_, Self>

Start an empty request.
Source§

fn with_system(&self, system: impl Into<String>) -> Request<'_, Self>

Start a request with system/context instructions.
Source§

fn with_media<'a>(&'a self, media: &'a [MediaFile]) -> Request<'a, Self>

Start a request with attached media (images, or PDFs where the provider supports them).
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more