Struct ServerUtilities 

pub struct ServerUtilities {
    pub service: ServiceId,
    pub name: &'static str,
    pub properties: Arc<DeviceProperties>,
    pub properties_hash: u64,
    pub target_properties: Arc<TargetProperties>,
    pub logger: Arc<ServerLogger>,
    pub layout_policy: Box<dyn MemoryLayoutPolicy>,
    pub server_comm_enabled: bool,
    pub check_mode: BoundsCheckMode,
    pub initialized_comms: RwLock<HashSet<CommunicationId>>,
}

Contains many different types that are useful for server implementations and compute clients.

Fields

service: ServiceId

The service these utilities belong to: what the handles it allocates are stamped with, and what a client compares them against.

name: &'static str

The runtime name on this device, as logs and cache keys show it: cuda, wgpu<spirv>.

properties: Arc<DeviceProperties>

Information shared between all servers.

properties_hash: u64

Stable hash of the device properties

target_properties: Arc<TargetProperties>

What the target the server compiles for guarantees about its own instructions — Runtime::target_properties resolved once, when the device came up, rather than on every launch.

A kernel keeps a clone of this Arc so it can expand itself on the device thread without naming a runtime, so building it per launch would put a TargetProperties construction — and the allocations inside it — on the hot path of every already-compiled kernel.

logger: Arc<ServerLogger>

The logger based on global cubecl configs.

layout_policy: Box<dyn MemoryLayoutPolicy>

How to create the allocation.

server_comm_enabled: bool

Whether the server can move data to a peer server of the same runtime directly, without a round trip through the host: the device transport Client::has_device_transport reports. Off unless the backend turns it on at init.

check_mode: BoundsCheckMode

How to enforce bounds checking on kernels.

initialized_comms: RwLock<HashSet<CommunicationId>>

A set containing the ids for which the inter-device communication has already been initialized.

Implementations

impl ServerUtilities

pub fn new( service: ServiceId, name: &'static str, properties: DeviceProperties, target_properties: TargetProperties, logger: Arc<ServerLogger>, allocator: impl MemoryLayoutPolicy, ) -> Self

Creates a new server utilities.

Trait Implementations

impl Debug for ServerUtilities

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.