Expand description
Pipeline Executor
This module provides a high-level pipeline executor that manages the separation between prefill and decode phases for optimal efficiency.
Structs§
- Pipeline
Config - Pipeline configuration
- Pipeline
Executor - Pipeline executor for efficient prefill/decode separation
- Pipeline
Sequence - Sequence being processed in the pipeline
- Pipeline
Stats Snapshot - Snapshot of pipeline statistics
Enums§
- Execution
Phase - Current execution phase