Struct Client 

pub struct Client<CTXEXT, FVVOTE, FCVOTE> {
    pub completion_votes_fetcher: Arc<FVVOTE>,
    pub cache_vote_fetcher: Arc<FCVOTE>,
    /* private fields */
}

Client for retrieving cached votes.

Fields

completion_votes_fetcher: Arc<FVVOTE>

Fetcher for votes from historical completions.

cache_vote_fetcher: Arc<FCVOTE>

Fetcher for votes from the global cache.

Implementations

impl<CTXEXT, FVVOTE, FCVOTE> Client<CTXEXT, FVVOTE, FCVOTE>

pub fn new( completion_votes_fetcher: Arc<FVVOTE>, cache_vote_fetcher: Arc<FCVOTE>, ) -> Self

Creates a new cache client.

impl<CTXEXT, FVVOTE, FCVOTE> Client<CTXEXT, FVVOTE, FCVOTE>

where CTXEXT: Send + Sync + 'static, FVVOTE: Fetcher<CTXEXT> + Send + Sync + 'static, FCVOTE: Fetcher<CTXEXT> + Send + Sync + 'static,

pub async fn fetch_completion_votes( &self, ctx: Context<CTXEXT>, id: &str, ) -> Result<CompletionVotes, ResponseError>

Retrieves all votes from a historical vector completion.

pub async fn fetch_cache_vote( &self, ctx: Context<CTXEXT>, model: &Model, models: Option<&[Model]>, messages: &[Message], tools: Option<&[Tool]>, responses: &[RichContent], ) -> Result<CacheVote, ResponseError>

Requests a vote from the global ObjectiveAI cache.

Returns a cached vote if one exists for the given model, messages, tools, and responses.

Trait Implementations

impl<CTXEXT: Clone, FVVOTE: Clone, FCVOTE: Clone> Clone for Client<CTXEXT, FVVOTE, FCVOTE>

fn clone(&self) -> Client<CTXEXT, FVVOTE, FCVOTE>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<CTXEXT: Debug, FVVOTE: Debug, FCVOTE: Debug> Debug for Client<CTXEXT, FVVOTE, FCVOTE>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.