Struct CommandLlmClient 

pub struct CommandLlmClient { /* private fields */ }

A shell-out LLM client. Clone-cheap: stores only the command string and timeout configuration.

Implementations

impl CommandLlmClient

pub fn new(command: impl Into<String>) -> Self

Construct a client that will run command via sh -c on every call. Default timeout is 120 seconds.

pub fn with_timeout(self, secs: u64) -> Self

Override the per-call timeout in seconds.

Trait Implementations

impl Clone for CommandLlmClient

fn clone(&self) -> CommandLlmClient

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CommandLlmClient

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl LlmClient for CommandLlmClient

fn complete<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, system: &'life1 str, user: &'life2 str, ) -> Pin<Box<dyn Future<Output = Result<String, MemoryError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Send a chat completion request and return the response text.

fn structured_output<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, system: &'life1 str, user: &'life2 str, ) -> Pin<Box<dyn Future<Output = Result<Value, MemoryError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Send a chat completion requesting structured JSON output. Returns the parsed JSON value.