Expand description
MockSchedulerEngine - AsyncEngine wrapper around the Scheduler
This module provides an AsyncEngine implementation that wraps the Scheduler to provide streaming token generation with realistic timing simulation.
Structs§
- Annotated
Mock Engine - Mock
Vllm Engine - AsyncEngine wrapper around the Scheduler that generates random character tokens
Constants§
Functions§
- make_
mocker_ engine - Create a mocker engine as ExecutionContext