Module ensemble_llm 

Ensemble LLM management, fetching, and retrieval. Ensemble LLM management, fetching, and retrieval.

An Ensemble LLM is a fully-specified configuration of a single upstream LLM, including model identity, prompt structure, decoding parameters, and output mode.

Modules

fetcher

Fetchers for retrieving Ensemble LLM definitions by ID. Fetchers for retrieving Ensemble LLM definitions.

retrieval_client

Retrieval clients for listing Ensemble LLMs and getting usage statistics. Retrieval clients for listing Ensemble LLMs and getting usage statistics.

Structs

Client

Client for Ensemble LLM operations.