Struct RuntimeExecutorBuilder 

pub struct RuntimeExecutorBuilder<P> { /* private fields */ }

Builder for composing AI providers with layers and plugins.

This builder allows for flexible composition following OpenDAL’s pattern:

• Layers wrap the provider (static dispatch during building)
• Plugins extend the runtime (stored for execution)

Example

let executor = RuntimeExecutor::builder(openai_provider)
    .layer(LoggingLayer::new())
    .layer(RetryLayer::new())
    .plugin(Arc::new(ToolUsePlugin::new()))
    .finish();

Implementations

impl<P: Provider> RuntimeExecutorBuilder<P>

pub fn new(provider: P) -> Self

Create a new builder with a provider

pub fn layer<L>(self, layer: L) -> RuntimeExecutorBuilder<L::LayeredProvider>

where L: Layer<P>,

Add a layer to wrap the provider

This uses static dispatch - each call to layer() creates a new concrete type by wrapping the previous provider.

pub fn plugin(self, plugin: Arc<dyn Plugin>) -> Self

Add a plugin to the runtime

pub fn json_strategy(self, strategy: Box<dyn JsonOutputStrategy>) -> Self

Set a custom JSON output strategy

If not set, the strategy will be auto-detected based on the provider ID.

pub fn finish(self) -> RuntimeExecutor

Finish building and create a RuntimeExecutor