pub struct OllamaProvider { /* private fields */ }Expand description
Ollama local model provider.
Implementations§
Trait Implementations§
Source§impl Default for OllamaProvider
impl Default for OllamaProvider
Source§impl LlmProvider for OllamaProvider
impl LlmProvider for OllamaProvider
Source§fn generate<'life0, 'async_trait>(
&'life0 self,
req: LlmRequest,
) -> Pin<Box<dyn Future<Output = Result<LlmResponse>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn generate<'life0, 'async_trait>(
&'life0 self,
req: LlmRequest,
) -> Pin<Box<dyn Future<Output = Result<LlmResponse>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
Generate a response (non-streaming)
Source§fn supports_model(&self, model: &str) -> bool
fn supports_model(&self, model: &str) -> bool
Models supported by this provider (prefix matching)
Auto Trait Implementations§
impl Freeze for OllamaProvider
impl !RefUnwindSafe for OllamaProvider
impl Send for OllamaProvider
impl Sync for OllamaProvider
impl Unpin for OllamaProvider
impl UnsafeUnpin for OllamaProvider
impl !UnwindSafe for OllamaProvider
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more