Expand description
Heterogeneous Device Support
This module provides device capability detection and adaptive resource management for running tensor operations across diverse hardware (edge to cloud).
Structs§
- Adaptive
Batch Sizer - Adaptive batch size calculator
- CpuInfo
- CPU information
- Device
Capabilities - Device capabilities
- Device
Profiler - Device profiler for performance optimization
- Memory
Info - Memory tier information
Enums§
- Device
Arch - Device architecture
- Device
Error - Device
Performance Tier - Device performance tier
- Device
Type - Device type classification