Trait CompletionClient 

pub trait CompletionClient {
    // Required methods
    fn complete(
        &mut self,
        messages: &[Value],
        cancel: &dyn Fn() -> bool,
    ) -> Result<Completion, ClientError>;
    fn requests(&self) -> u64;
}

Something that answers chat completions (HTTP, or a replay in tests).

Required Methods

fn complete( &mut self, messages: &[Value], cancel: &dyn Fn() -> bool, ) -> Result<Completion, ClientError>

Send the conversation; cancel is polled while waiting.

fn requests(&self) -> u64

Requests sent so far (retries included).

Dyn Compatibility

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors

impl CompletionClient for HttpClient