Structs§
- Direct
Request - Mock
Engine Args - Configuration arguments for MockVllmEngine
- Mock
Engine Args Builder - Builder for
MockEngineArgs. - Output
Signal - Signal for output token generation with completion status
- Prefill
Cost - Represents the cost of prefilling content in the cache
Enums§
- Mock
Engine Args Builder Error - Error type for MockEngineArgsBuilder
- Move
Block - Represents different block movement operations in the cache For Use and Promote variants, parent hash is the second field
- Move
Block Response
Functions§
- block_
response_ to_ kv_ event - Converts a MoveBlockResponse from the mocker backend into a KvCacheEventData.