Expand description
Model-specific parallel topology contracts.
The rank planner is reusable, but model support is never inferred from a loader or a few
scalar dimensions. Each family must register the complete geometry that its TP/EP program
shards. Step-3.7-Flash is the first registered contract because its query-head count varies by
layer (64 full-attention / 96 sliding-attention), while KV heads stay at 8. Step-3.5 and other
siblings do not inherit this contract merely because they share the step35 architecture tag.
Structs§
Enums§
Constants§
- PRODUCT_
MAX_ CARDS - The execution planner’s supported rank envelope. Hardware qualification and tuned defaults remain model x rig evidence, but the placement/runtime contract must not stop at the three cards currently available on Pod B.
Functions§
- validate_
step_ pp_ request - Validate the live Step PP request before the loader allocates CUDA state. Checkpoint tensor census is deliberately a separate loader gate: topology legality must remain testable without opening model files, while serving requires both gates.