pub struct GenaiLlmExecutor { /* private fields */ }Expand description
Default LLM executor backed by genai::Client.
Implementations§
Trait Implementations§
Source§impl Clone for GenaiLlmExecutor
impl Clone for GenaiLlmExecutor
Source§fn clone(&self) -> GenaiLlmExecutor
fn clone(&self) -> GenaiLlmExecutor
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for GenaiLlmExecutor
impl Debug for GenaiLlmExecutor
Source§impl LlmExecutor for GenaiLlmExecutor
impl LlmExecutor for GenaiLlmExecutor
Source§fn exec_chat_response<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
model: &'life1 str,
chat_req: ChatRequest,
options: Option<&'life2 ChatOptions>,
) -> Pin<Box<dyn Future<Output = Result<ChatResponse>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
fn exec_chat_response<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
model: &'life1 str,
chat_req: ChatRequest,
options: Option<&'life2 ChatOptions>,
) -> Pin<Box<dyn Future<Output = Result<ChatResponse>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
Execute one non-streaming chat call.
Source§fn exec_chat_stream_events<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
model: &'life1 str,
chat_req: ChatRequest,
options: Option<&'life2 ChatOptions>,
) -> Pin<Box<dyn Future<Output = Result<LlmEventStream>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
fn exec_chat_stream_events<'life0, 'life1, 'life2, 'async_trait>(
&'life0 self,
model: &'life1 str,
chat_req: ChatRequest,
options: Option<&'life2 ChatOptions>,
) -> Pin<Box<dyn Future<Output = Result<LlmEventStream>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
Execute one streaming chat call.
Auto Trait Implementations§
impl Freeze for GenaiLlmExecutor
impl !RefUnwindSafe for GenaiLlmExecutor
impl Send for GenaiLlmExecutor
impl Sync for GenaiLlmExecutor
impl Unpin for GenaiLlmExecutor
impl UnsafeUnpin for GenaiLlmExecutor
impl !UnwindSafe for GenaiLlmExecutor
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more