Expand description
Mock LLM scheduler and KV manager for testing.
This crate provides a mock implementation of an LLM scheduler that simulates KV cache management, request scheduling, and token generation timing without requiring actual GPU resources or a full distributed runtime.
Modules§
- common
- Shared components used across all engine implementations.
- engine
- Single-rank compatibility entry points for the grouped generalized engine.
- grouped_
scheduler - Compatibility facade from Dynamo’s live scheduler handles to one grouped AISimulate engine.
- live
- Reusable live-request boundary for the Mocker schedulers.
- loadgen
- Dynamo composition adapters for the AISimulate workload driver.
- replay
- scheduler
- Dynamo-facing protocol for the shared AISimulate generalized engine.
- services
- Runtime services used by the mocker.