Struct HanzoBuilder 

pub struct HanzoBuilder { /* private fields */ }

The HanzoBuilder takes the pipeline and a scheduler method and constructs an Engine and a Hanzo instance. The Engine runs on a separate thread, and the Hanzo instance stays on the calling thread.

Implementations

impl HanzoBuilder

pub fn new( pipeline: Arc<Mutex<dyn Pipeline>>, method: SchedulerConfig, throughput_logging: bool, search_embedding_model: Option<SearchEmbeddingModel>, ) -> Self

Creates a new builder with the given pipeline, scheduler method, logging flag, and optional embedding model for web search. To override the search callback, use .with_search_callback(...) on the builder.

pub fn with_model_id(self, model_id: impl Into<String>) -> Self

Override the model ID used by Hanzo. Defaults to the pipeline name.

pub fn with_loader_config(self, loader_config: ModelLoaderConfig) -> Self

Set the loader config for enabling model unload/reload support. Without this, models cannot be unloaded and reloaded.

pub fn with_log(self, log: String) -> Self

pub fn with_opt_log(self, log: Option<String>) -> Self

pub fn with_no_kv_cache(self, no_kv_cache: bool) -> Self

pub fn with_no_prefix_cache(self, no_prefix_cache: bool) -> Self

pub fn with_prefix_cache_n(self, prefix_cache_n: usize) -> Self

pub fn with_disable_eos_stop(self, disable_eos_stop: bool) -> Self

pub fn with_search_callback(self, search_callback: Arc<SearchCallback>) -> Self

Use a custom callback to gather search results.

pub fn with_tool_callback( self, name: impl Into<String>, tool_callback: Arc<ToolCallback>, ) -> Self

Register a custom callback for the specified tool name.

pub fn with_tool_callback_and_tool( self, name: impl Into<String>, tool_callback: Arc<ToolCallback>, tool: Tool, ) -> Self

Register a custom callback with its associated Tool definition. The Tool will be automatically added to requests when tool callbacks are active.

pub fn with_tool_callback_with_tool( self, name: impl Into<String>, callback_with_tool: ToolCallbackWithTool, ) -> Self

Register a pre-built tool callback with its Tool definition.

pub fn with_mcp_client(self, config: McpClientConfig) -> Self

Configure MCP client to connect to external MCP servers.

pub fn with_code_execution(self, config: CodeExecutionConfig) -> Self

Enable Python code execution. Security: lets the model run arbitrary code on the host with full network and filesystem access.

pub async fn build(self) -> Arc<Hanzo>