Struct GeminiProvider 

pub struct GeminiProvider { /* private fields */ }

Client for the Google Gemini API (POST {base_url}/models/{model}:generateContent, key in x-goog-api-key), or for Gemini on Vertex AI via vertex.

Implementations

impl GeminiProvider

pub fn new(api_key: impl Into<String>) -> Self

pub fn vertex( project: impl Into<String>, region: impl Into<String>, access_token: impl Into<String>, ) -> Self

Gemini on Google Cloud Vertex AI. access_token is an OAuth token (e.g. gcloud auth print-access-token); region is e.g. global or us-central1.

pub fn with_base_url(self, base_url: impl Into<String>) -> Self

pub fn with_client(self, client: Client) -> Self

Uses your own reqwest::Client, for example to share a connection pool or set a proxy.

pub fn with_max_retries(self, max_retries: u32) -> Self

How many times a failed request is retried (default DEFAULT_MAX_RETRIES; 0 disables).

Trait Implementations

impl Clone for GeminiProvider

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GeminiProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl EmbeddingProvider for GeminiProvider

fn embed<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, model: &'life1 str, inputs: &'life2 [&'life3 str], ) -> Pin<Box<dyn Future<Output = Result<Embeddings>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

impl LlmProvider for GeminiProvider

fn chat<'life0, 'life1, 'async_trait>( &'life0 self, req: &'life1 ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Sends the request and waits for the whole answer.

fn chat_stream<'life0, 'life1, 'async_trait>( &'life0 self, req: &'life1 ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatStream>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Streams the answer as it is generated. The last event is StreamEvent::Done with the full response.

fn list_models<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<Vec<ModelInfo>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Models available to the key.