Struct RetryingModel 

pub struct RetryingModel<M> { /* private fields */ }

Wraps a CompletionModel, retrying transient failures on every call.

Implementations

impl<M> RetryingModel<M>

pub fn new(inner: M) -> Self

Trait Implementations

impl<M: Clone> Clone for RetryingModel<M>

fn clone(&self) -> RetryingModel<M>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<M: CompletionModel> CompletionModel for RetryingModel<M>

type Response = <M as CompletionModel>::Response

The raw response type returned by the underlying completion model.

type StreamingResponse = <M as CompletionModel>::StreamingResponse

The raw response type returned by the underlying completion model when streaming.

type Client = <M as CompletionModel>::Client

Provider client type used to construct this model.

fn make(client: &Self::Client, model: impl Into<String>) -> Self

Construct a model handle from a provider client and model identifier.

async fn completion( &self, request: CompletionRequest, ) -> Result<CompletionResponse<Self::Response>, CompletionError>

Generates a completion response for the given completion request.

async fn stream( &self, request: CompletionRequest, ) -> Result<StreamingCompletionResponse<Self::StreamingResponse>, CompletionError>

fn completion_request( &self, prompt: impl Into<Message>, ) -> CompletionRequestBuilder<Self>

Generates a completion request builder for the given prompt.