Struct BoxedProvider 

pub struct BoxedProvider(/* private fields */);

Type-erased LLM provider for use when dynamic dispatch is needed.

Wraps any LlmProvider behind Box<dyn DynLlmProvider>. Implements LlmProvider itself, so it can be used with AgentRunner<BoxedProvider> and Orchestrator<BoxedProvider>, eliminating the need for generic code at the call site.

Example

let provider = BoxedProvider::new(AnthropicProvider::new(key, model));
let runner = AgentRunner::builder(Arc::new(provider))
    .name("agent")
    .build()?;

Implementations

impl BoxedProvider

pub fn new<P: LlmProvider + 'static>(provider: P) -> Self

Create a type-erased provider from any concrete LlmProvider.

pub fn from_arc<P: LlmProvider + 'static>(provider: Arc<P>) -> Self

Create a type-erased provider from an Arc<P>.

Useful when the provider is already behind an Arc (e.g., shared between the orchestrator and sub-agents) and needs to be converted to BoxedProvider for type erasure without consuming the original.

Trait Implementations

impl LlmProvider for BoxedProvider

async fn complete( &self, request: CompletionRequest, ) -> Result<CompletionResponse, Error>

Send a completion request and wait for the full response.

async fn stream_complete( &self, request: CompletionRequest, on_text: &OnText, ) -> Result<CompletionResponse, Error>

Stream a completion, calling on_text for each text delta as it arrives.

fn model_name(&self) -> Option<&str>

Return the model identifier, if known.