Expand description
AMAC-style interleaved hostcall batch executor with stall-aware toggling.
AMAC (Asynchronous Memory Access Chaining) interleaves multiple independent hostcall state machines per scheduler tick to hide memory-access latency. When the working set exceeds the LLC, sequential dispatch stalls on cache misses; interleaving lets one request’s computation overlap another’s memory fetch, improving throughput by up to the memory-level parallelism ratio.
The executor dynamically toggles between batched-interleaved and sequential dispatch based on observed per-call timing telemetry as a proxy for LLC miss rates and stall cycles.
Structs§
- Amac
Batch Executor - The AMAC batch executor.
- Amac
Batch Executor Config - AMAC batch executor configuration.
- Amac
Batch Group - A group of hostcall requests that share a batch key and can be dispatched together.
- Amac
Batch Plan - Execution plan for a batch of hostcall requests.
- Amac
Batch Result - Result of executing a batch plan.
- Amac
Batch Telemetry - Per-batch execution telemetry.
- Amac
Stall Telemetry - Stall telemetry tracker using exponential moving averages.
- Amac
Stall Telemetry Snapshot - Immutable snapshot of stall telemetry for reporting.
Enums§
- Amac
Group Key - Grouping key for batching compatible hostcall requests together.
- Amac
Toggle Decision - The decision of whether to use AMAC interleaving or sequential dispatch.