Skip to main content

create_product_engine

Function create_product_engine 

Source
pub async fn create_product_engine(
    config: EngineConfig,
    sources: Arc<ProductionModelSourceBundle>,
) -> Result<Box<dyn LlmInferenceEngine + Send + Sync>>
Expand description

Create a product engine from one immutable role-specific source bundle.