pub struct LlmQueryChannel {
pub request_tx: Sender<LlmSubRequest>,
pub response_rx: Arc<Mutex<Receiver<String>>>,
}Expand description
Channel pair for synchronous LLM sub-queries from Lua code.
When llm_query(prompt) is called in Lua, it sends the prompt through request_tx
and blocks on response_rx. The RLM engine fulfills requests asynchronously.
Fields§
§request_tx: Sender<LlmSubRequest>§response_rx: Arc<Mutex<Receiver<String>>>Auto Trait Implementations§
impl Freeze for LlmQueryChannel
impl RefUnwindSafe for LlmQueryChannel
impl Send for LlmQueryChannel
impl Sync for LlmQueryChannel
impl Unpin for LlmQueryChannel
impl UnsafeUnpin for LlmQueryChannel
impl UnwindSafe for LlmQueryChannel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more