onnx-runtime-memory-api 0.1.0-dev.6

Low-dependency memory mechanism contracts shared by allocators, governors, and execution providers
Documentation
  • Coverage
  • 47.83%
    187 out of 391 items documented0 out of 231 items with examples
  • Size
  • Source code size: 266.45 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 4.04 MB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 10s Average build duration of successful builds.
  • all releases: 10s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • justinchuby/onnx-genai
    7 1 229
  • crates.io
  • Dependencies
  • Versions
  • Owners
  • justinchuby

onnx-runtime-memory-api

Low-dependency memory mechanism contracts shared by allocators, governors, and execution providers.

This crate is the lowest layer of the runtime memory stack. It owns the minimum ordinary allocator contract, explicit optional virtual-backing and shared-mapping capabilities, manager-issued binding identity/lifetime pins, and the owning/deferred-release contract that says who owns a physical release and what is true after one partially fails. It does not own allocation policy, accounting, synchronization, or process-level transaction management.

Governor-specific capacity tokens and grants remain in onnx-runtime-memory-governor; they are not methods every allocator or optional capability must implement.