Skip to main content

Module dispatch_shape

Module dispatch_shape 

Source
Expand description

Backend-neutral dispatch-shape comparison helpers. Backend-neutral dispatch shape comparison helpers.

CUDA graph replay, pipeline cache reuse, and future backend command replay all need the same answer to two questions: do these borrowed input batches have the same byte shape, and does a runtime DispatchConfig preserve the launch-relevant shape captured at compile time?

Functionsยง

borrowed_input_batch_shapes_match
Return true when every borrowed-input batch item has the same shape as the first item.
borrowed_input_shapes_match
Return true when two borrowed input lists have the same arity and per-input byte lengths.
dispatch_configs_share_launch_shape
Return true when a runtime dispatch config preserves a compiled launch shape.