onnx-runtime-shape-inference

Symbolic shape inference over the [onnx_runtime_ir::Graph] IR.

This crate is the general, extensible successor to the bounded shape- inference stopgaps elsewhere in the runtime (the loader's const-fold-lite pass and the session's just-in-time data-dependent resolution). Its design mirrors the reference implementation justinchuby/onnx-shape-inference:

1. Extensible per-op registry keyed by (domain, op_type, opset) with range-based version matching ([InferenceRegistry]). Unregistered ops leave their outputs unresolved rather than failing.
2. Symbolic dimension arithmetic ([DimExpr]) — a small canonical integer polynomial that captures the affine/product forms the op set produces (d0*d1, d0+k, d0/k, reshape -1 cancellation), lowered back to IR Dims only when writing results.
3. Shape-DATA propagation ([ShapeData]) — tracks the known element values of the small integer tensors in Shape → Slice → Concat → Gather → Unsqueeze → Reshape chains, so computed shapes resolve without executing the graph. This is what lets transformer graphs infer statically.
4. Merge policies ([MergePolicy]) — Strict (concrete disagreements are errors) and Permissive (prefer the more specific dim and keep going; the robust default).

Usage

use onnx_runtime_shape_inference::{InferenceRegistry, MergePolicy};
# fn demo(graph: &mut onnx_runtime_ir::Graph) {
let registry = InferenceRegistry::default_registry();
let opsets = graph.opset_imports.clone();
let report = registry
    .infer_graph(graph, &opsets, MergePolicy::Permissive)
    .expect("inference");
assert!(report.fully_resolved());
# }

Single-node inference (for testing or custom passes) is available via [InferenceRegistry::infer_node].

Design invariants

• Model-agnostic. Rules dispatch purely on (domain, op_type, opset) and tensor metadata — never on model names or op counts.
• The IR contract is not modified. Derived dimensions live in this crate's [DimExpr] and are lowered to a fresh symbol when they cannot be expressed as an IR Dim.
• Permissive by default, never panics on unknown input. Errors are reserved for genuine contract violations (see [ShapeInferError]).