Expand description
Tensor caching and memory pooling for efficient execution.
Structs§
- Cache
Key - Cache key for tensor identification
- Cache
Stats - Cache statistics
- Memory
Pool - Memory pool for tensor allocation reuse
- Pool
Stats - Memory pool statistics
- Tensor
Cache - Tensor cache with configurable eviction policy
Enums§
- Eviction
Policy - Cache eviction policy