Skip to main content

Module hostcall_amac

Module hostcall_amac 

Source
Expand description

AMAC-style interleaved hostcall batch executor with stall-aware toggling.

AMAC (Asynchronous Memory Access Chaining) interleaves multiple independent hostcall state machines per scheduler tick to hide memory-access latency. When the working set exceeds the LLC, sequential dispatch stalls on cache misses; interleaving lets one request’s computation overlap another’s memory fetch, improving throughput by up to the memory-level parallelism ratio.

The executor dynamically toggles between batched-interleaved and sequential dispatch based on observed per-call timing telemetry as a proxy for LLC miss rates and stall cycles.

Structs§

AmacBatchExecutor
The AMAC batch executor.
AmacBatchExecutorConfig
AMAC batch executor configuration.
AmacBatchGroup
A group of hostcall requests that share a batch key and can be dispatched together.
AmacBatchPlan
Execution plan for a batch of hostcall requests.
AmacBatchResult
Result of executing a batch plan.
AmacBatchTelemetry
Per-batch execution telemetry.
AmacStallTelemetry
Stall telemetry tracker using exponential moving averages.
AmacStallTelemetrySnapshot
Immutable snapshot of stall telemetry for reporting.

Enums§

AmacGroupKey
Grouping key for batching compatible hostcall requests together.
AmacToggleDecision
The decision of whether to use AMAC interleaving or sequential dispatch.