onnx-runtime-quantization 0.1.0-dev.4

Shared audited quantization tables for ONNX Runtime execution providers
Documentation
  • Coverage
  • 12.5%
    1 out of 8 items documented0 out of 0 items with examples
  • Size
  • Source code size: 93.83 kB This is the summed size of all the files inside the crates.io package for this release.
  • Documentation size: 542.96 kB This is the summed size of all files generated by rustdoc for all configured targets
  • Ø build duration
  • this release: 3s Average build duration of successful builds.
  • all releases: 2s Average build duration of successful builds in releases after 2024-10-23.
  • Links
  • justinchuby/onnx-genai
    4 0 43
  • crates.io
  • Dependencies
    • —
  • Versions
  • Owners
  • justinchuby

Audited llama.cpp IQ quantization grids shared by CPU and GPU decoders.