Module engine

Module engine 

Source
Expand description

MockSchedulerEngine - AsyncEngine wrapper around the Scheduler

This module provides an AsyncEngine implementation that wraps the Scheduler to provide streaming token generation with realistic timing simulation.

Structs§

AnnotatedMockEngine
MockVllmEngine
AsyncEngine wrapper around the Scheduler that generates random character tokens

Constants§

MOCKER_COMPONENT

Functions§

make_mocker_engine
Create a mocker engine as ExecutionContext