Struct HostSlotMemory 

pub struct HostSlotMemory { /* private fields */ }

A pool whose “device” is host memory.

A real implementation, not a stand-in: on a CPU-only build the expert pool is host memory and the link is a memcpy, so this is the backend that build uses. It is also what makes every rule above testable on a machine with no GPU, which is the whole reason the device lives behind a trait.

Implementations

impl HostSlotMemory

pub fn new(geometry: &SlotGeometry) -> Self

pub fn slot(&self, bank: usize, slot: u32) -> &[u8]

The bytes one slot holds in one bank. This is what makes the pool checkable: a test can assert the slot contains the expert the plan promised, not merely that a copy was counted.

Trait Implementations

impl SlotDevice for HostSlotMemory

fn write_slot( &mut self, bank: usize, dst_slot: u32, src: &[u8], ) -> Result<(), String>

Writes one expert row from host memory into dst_slot. src is exactly row_bytes[bank] long; the implementation may rely on that.

fn copy_slot( &mut self, bank: usize, dst_slot: u32, src_slot: u32, ) -> Result<(), String>

Copies one slot onto another within the pool, without touching the host. This is what makes a prefill gather cheaper than a re-fetch: the bytes are already on the far side of the link.

fn begin_plan(&mut self, route: CopyRoute) -> Result<(), String>

Announces how the copies about to be issued must be carried out. Called once per plan, before the first copy.

fn flush(&mut self) -> Result<(), String>

Completes any deferred copies. Called once per plan, after the last copy is issued.