Module shared_memory

Module shared_memory 

Source
Expand description

Shared memory support for zero-copy IPC

Provides mmap-based buffer sharing for:

  • Cross-process tensor sharing
  • Zero-copy IPC between processes
  • Memory-efficient model serving

Structs§

SharedBufferHeader
Header stored at the beginning of shared memory
SharedMemoryPool
Shared memory pool for managing multiple buffers
SharedTensorBuffer
Shared memory region for tensor data
SharedTensorBufferReadOnly
Read-only shared tensor buffer
SharedTensorInfo
Metadata for tensors in shared memory

Enums§

SharedMemoryError
Error types for shared memory operations