Struct AzureAIClient 

pub struct AzureAIClient { /* private fields */ }

Available on crate feature models only.

Azure AI Inference client for models hosted on Azure AI endpoints.

Supports models like Cohere, Llama, and Mistral deployed via Azure AI Inference. Uses api-key header authentication and the Azure AI chat completions REST API.

Example

use adk_model::azure_ai::{AzureAIClient, AzureAIConfig};

let config = AzureAIConfig::new(
    "https://my-endpoint.eastus.inference.ai.azure.com",
    "my-api-key",
    "meta-llama-3.1-8b-instruct",
);
let client = AzureAIClient::new(config)?;

Implementations

impl AzureAIClient

pub fn new(config: AzureAIConfig) -> Result<AzureAIClient, AdkError>

Available on crate feature azure-ai only.

Create a new Azure AI Inference client from the given config.

pub fn with_retry_config(self, retry_config: RetryConfig) -> AzureAIClient

Available on crate feature azure-ai only.

Set the retry configuration, consuming and returning self for builder chaining.

pub fn set_retry_config(&mut self, retry_config: RetryConfig)

Available on crate feature azure-ai only.

Set the retry configuration by mutable reference.

pub fn retry_config(&self) -> &RetryConfig

Available on crate feature azure-ai only.

Return a reference to the current retry configuration.

Trait Implementations

impl Llm for AzureAIClient

fn name(&self) -> &str

fn generate_content<'life0, 'async_trait>( &'life0 self, request: LlmRequest, stream: bool, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>

where 'life0: 'async_trait, AzureAIClient: 'async_trait,