Struct GpuRuntime 

pub struct GpuRuntime {
    pub device: GpuDeviceInfo,
    pub devices: Vec<GpuDeviceInfo>,
    pub policy: GpuDispatchPolicy,
    pub memory_budget_bytes: usize,
}

Fields

device: GpuDeviceInfo

Highest-scoring probed CUDA device. Existing dispatch code routes one-shot kernels through this device.

devices: Vec<GpuDeviceInfo>

All usable CUDA devices discovered at probe time, ordered by score.

policy: GpuDispatchPolicy

memory_budget_bytes: usize

Implementations

impl GpuRuntime

pub fn probe() -> Result<GpuAvailability, GpuError>

pub fn availability() -> Result<GpuAvailabilityRef<'static>, GpuError>

Return the cached probe outcome without collapsing faults into absence.

pub fn resolve(policy: GpuPolicy) -> Result<Option<&'static Self>, GpuError>

Resolve CUDA under an explicit policy. Ok(None) is reserved for a genuine absence under Auto/Off; probe faults always remain Err, and Required converts absence into RequiredDeviceUnavailable.

pub fn require() -> Result<&'static Self, GpuError>

Resolve CUDA under Required semantics and return the device handle.

pub fn resolve_if_fused_batch_exceeds_floor( policy: GpuPolicy, rows: usize, ) -> Result<Option<&'static Self>, GpuError>

Size-gated Self::resolve for independent fused row kernels.

Batches below GpuDispatchPolicy::MIN_CALIBRATABLE_FUSED_KERNEL_N cannot be admitted by either the default or any device-calibrated policy. Refuse them before availability resolution so a CPU-sized first call does not create CUDA contexts and run calibration merely to learn that it should stay on the CPU. At and above the universal floor, the concrete runtime’s calibrated policy remains authoritative.

pub fn policy(&self) -> &GpuDispatchPolicy

pub fn selected_device(&self) -> &GpuDeviceInfo

impl GpuRuntime

pub fn device_ordinals(&self) -> Vec<usize>

Ordinals of all usable devices, highest-score first.

self.devices is already score-sorted at probe time, so this simply projects out the ordinals. Empty only if the probe somehow produced no devices (the public probe() guarantees at least one on Ok(Some(_))).

pub fn device_count(&self) -> usize

Number of usable devices in the pool.

pub fn memory_budget_for(&self, ordinal: usize) -> usize

Per-device byte budget: free memory capped at half of total, matching the primary-device budget computed in device_runtime::probe. Falls back to the primary memory_budget_bytes when the ordinal is not in the pool so a caller that passes a stale ordinal still gets a usable (conservative) budget rather than zero.

Trait Implementations

impl Clone for GpuRuntime

fn clone(&self) -> GpuRuntime

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GpuRuntime

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.