pub struct OllamaModel { /* private fields */ }Available on crate feature
models only.Expand description
Ollama client for local LLM inference.
Implementations§
Source§impl OllamaModel
impl OllamaModel
Sourcepub fn new(config: OllamaConfig) -> Result<OllamaModel, AdkError>
Available on crate feature ollama only.
pub fn new(config: OllamaConfig) -> Result<OllamaModel, AdkError>
ollama only.Create a new Ollama client with the given configuration.
Sourcepub fn from_model(model: impl Into<String>) -> Result<OllamaModel, AdkError>
Available on crate feature ollama only.
pub fn from_model(model: impl Into<String>) -> Result<OllamaModel, AdkError>
ollama only.Create a client with default settings for a given model.
Trait Implementations§
Source§impl Llm for OllamaModel
impl Llm for OllamaModel
fn name(&self) -> &str
fn generate_content<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
stream: bool,
) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<LlmResponse, AdkError>> + Send>>, AdkError>> + Send + 'async_trait>>where
'life0: 'async_trait,
OllamaModel: 'async_trait,
Auto Trait Implementations§
impl Freeze for OllamaModel
impl !RefUnwindSafe for OllamaModel
impl Send for OllamaModel
impl Sync for OllamaModel
impl Unpin for OllamaModel
impl UnsafeUnpin for OllamaModel
impl !UnwindSafe for OllamaModel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> FutureExt for T
impl<T> FutureExt for T
Source§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
Source§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::RequestCreates a shared type from an unshared type.