Expand description
Device abstraction for liquid-edge inference
This module provides device abstractions following the USLS pattern. Devices are simple enums that can be converted to ORT execution providers.
Enums§
- Device
- Device types for model execution, following USLS pattern
Functions§
- cpu
- Convenience functions for device creation
- cpu_
with_ threads - cuda
- cuda_
default