Skip to main content

create_prepared_product_engine

Function create_prepared_product_engine 

Source
pub async fn create_prepared_product_engine(
    config: EngineConfig,
    prepared: Arc<PreparedProductionModel>,
) -> Result<Box<dyn LlmInferenceEngine + Send + Sync>>
Expand description

Create a product engine from the exact typed model package already used by startup capability and resource-policy resolution.