pub struct AzureFoundryProvider { /* private fields */ }Expand description
Azure AI Foundry provider.
URL format: {endpoint}/models/chat/completions?api-version=2024-05-01-preview
Auth header: api-key: {api_key}
Supports model names prefixed with “foundry:” (e.g. “foundry:phi-4”).
Implementations§
Trait Implementations§
Source§impl LlmProvider for AzureFoundryProvider
impl LlmProvider for AzureFoundryProvider
Source§fn generate<'life0, 'async_trait>(
&'life0 self,
req: LlmRequest,
) -> Pin<Box<dyn Future<Output = Result<LlmResponse>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn generate<'life0, 'async_trait>(
&'life0 self,
req: LlmRequest,
) -> Pin<Box<dyn Future<Output = Result<LlmResponse>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
Generate a response (non-streaming)
Source§fn supports_model(&self, model: &str) -> bool
fn supports_model(&self, model: &str) -> bool
Models supported by this provider (prefix matching)
Auto Trait Implementations§
impl Freeze for AzureFoundryProvider
impl !RefUnwindSafe for AzureFoundryProvider
impl Send for AzureFoundryProvider
impl Sync for AzureFoundryProvider
impl Unpin for AzureFoundryProvider
impl UnsafeUnpin for AzureFoundryProvider
impl !UnwindSafe for AzureFoundryProvider
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more