Struct Device 

pub struct Device { /* private fields */ }

A device on which tensors can be created and computations performed.

Internally this is an Arc<dyn DynBackendDevice> — a trait-object handle to the concrete backend device. CPU, CUDA, Metal, and arbitrary third-party backends are all accessed through this single type.

Example

use fuel_tensor::{Device, DType};
use fuel_tensor::lazy::Tensor;
let dev = Device::cpu();
let t = Tensor::zeros((2, 3), DType::F32, &dev)?;
assert_eq!(t.shape().dims(), &[2, 3]);

Implementations

impl Device

pub fn cpu() -> Self

Returns a CPU device.

Example

use fuel_tensor::Device;
let dev = Device::cpu();
assert!(dev.is_cpu());

pub fn custom(device: Arc<dyn DynBackendDevice>) -> Self

Creates a device backed by a custom DynBackendDevice.

The device uses dynamic dispatch for all operations, enabling third-party backends without modifying fuel-core.

pub fn as_dyn(&self) -> &Arc<dyn DynBackendDevice>

Borrow the underlying Arc<dyn DynBackendDevice>.

Phase 7.5 work item G2: fuel-graph’s slot-populating constructors (Tensor::from_f32, const_f32_like, etc.) take a &Arc<dyn DynBackendDevice> so they can allocate Storage on the right device without depending on fuel-core. Callers that hold a &fuel_tensor::Device thread it through with dev.as_dyn().

pub fn is_custom(&self) -> bool

Returns true if this is a custom (third-party) device.

pub fn set_seed(&self, seed: u64) -> Result<()>

Sets the random seed for this device’s random number generator.

pub fn get_current_seed(&self) -> Result<u64>

Returns the current random seed for this device.

pub fn same_device(&self, rhs: &Self) -> bool

Returns true if both devices refer to the same physical device.

Example

use fuel_tensor::Device;
assert!(Device::cpu().same_device(&Device::cpu()));

pub fn location(&self) -> DeviceLocation

Returns the physical DeviceLocation for this device.

Example

use fuel_tensor::{Device, DeviceLocation};
assert_eq!(Device::cpu().location(), DeviceLocation::Cpu);

pub fn is_cpu(&self) -> bool

Returns true if this is the CPU device.

Example

use fuel_tensor::Device;
assert!(Device::cpu().is_cpu());

pub fn is_cuda(&self) -> bool

Returns true if this is a CUDA device.

Example

use fuel_tensor::Device;
assert!(!Device::cpu().is_cuda());

pub fn is_metal(&self) -> bool

Returns true if this is a Metal device.

Example

use fuel_tensor::Device;
assert!(!Device::cpu().is_metal());

pub fn supports_bf16(&self) -> bool

Returns true if this device has native BF16 support.

Example

use fuel_tensor::Device;
// CPU does not have native BF16 support
assert!(!Device::cpu().supports_bf16());

pub fn bf16_default_to_f32(&self) -> DType

Returns DType::BF16 if supported, otherwise DType::F32.

Example

use fuel_tensor::{Device, DType};
assert_eq!(Device::cpu().bf16_default_to_f32(), DType::F32);

pub fn synchronize(&self) -> Result<()>

Synchronizes the device, waiting for all pending operations to complete.

This is a no-op on CPU.

use fuel_tensor::Device;
Device::cpu().synchronize()?;

Trait Implementations

impl Clone for Device

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Device

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.