Skip to main content

execute_pipeline

Function execute_pipeline 

Source
pub fn execute_pipeline(
    plan: &PipelinePlan,
    token_count: usize,
    micro_batch: usize,
) -> Result<ExecutionResult, String>
Expand description

Execute pipeline stages with real channel/thread wiring for token_count tokens.

micro_batch controls how many tokens are packaged per batch. Values below 1 are clamped to 1.