Struct Client 

pub struct Client<CTXEXT, FENSLLM, RTRVL> {
    pub ensemble_llm_fetcher: Arc<CachingFetcher<CTXEXT, FENSLLM>>,
    pub retrieval_client: Arc<RTRVL>,
    pub _ctx_ext: PhantomData<CTXEXT>,
}

Client for Ensemble LLM operations.

Combines a caching fetcher for Ensemble LLM definitions with a retrieval client for listing and usage statistics.

Fields

ensemble_llm_fetcher: Arc<CachingFetcher<CTXEXT, FENSLLM>>

Caching fetcher for Ensemble LLM definitions.

retrieval_client: Arc<RTRVL>

Client for listing Ensemble LLMs and getting usage.

_ctx_ext: PhantomData<CTXEXT>

Phantom data for the context extension type.

Implementations

impl<CTXEXT, FENSLLM, RTRVL> Client<CTXEXT, FENSLLM, RTRVL>

pub fn new( ensemble_llm_fetcher: Arc<CachingFetcher<CTXEXT, FENSLLM>>, retrieval_client: Arc<RTRVL>, ) -> Self

Creates a new Ensemble LLM client.

impl<CTXEXT, FENSLLM, RTRVL> Client<CTXEXT, FENSLLM, RTRVL>

where CTXEXT: Send + Sync + 'static, FENSLLM: Fetcher<CTXEXT> + Send + Sync + 'static, RTRVL: Client<CTXEXT> + Send + Sync + 'static,

pub async fn list( &self, ctx: Context<CTXEXT>, ) -> Result<ListEnsembleLlm, ResponseError>

Lists all Ensemble LLMs.

pub async fn get( &self, ctx: Context<CTXEXT>, id: &str, ) -> Result<GetEnsembleLlm, ResponseError>

Retrieves an Ensemble LLM by its ID.

Returns a 404 error if the Ensemble LLM is not found.

pub async fn get_usage( &self, ctx: Context<CTXEXT>, id: &str, ) -> Result<UsageEnsembleLlm, ResponseError>

Retrieves usage statistics for an Ensemble LLM.