pub struct LlmRuntimeAdapter { /* private fields */ }Expand description
LLM runtime adapter — sends script as a prompt to an LLM API endpoint.
Under native, uses ureq for synchronous HTTP POST.
Under WASM, a scaffold is provided that returns an error (async HTTP fetch
via wasm-bindgen-futures is future work).
The endpoint URL and API key are read from CLM_LLM_ENDPOINT and
CLM_LLM_API_KEY environment variables. If not set, defaults to
http://localhost:8080/v1/chat/completions with no auth.
Implementations§
Trait Implementations§
Source§impl Default for LlmRuntimeAdapter
impl Default for LlmRuntimeAdapter
Auto Trait Implementations§
impl Forget for LlmRuntimeAdapter
impl Freeze for LlmRuntimeAdapter
impl RefUnwindSafe for LlmRuntimeAdapter
impl Send for LlmRuntimeAdapter
impl Sync for LlmRuntimeAdapter
impl Unpin for LlmRuntimeAdapter
impl UnsafeUnpin for LlmRuntimeAdapter
impl UnwindSafe for LlmRuntimeAdapter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more