Expand description
User-requested numerical execution policy. Device capabilities and model family contracts resolve this request before any model execution begins.
Structs§
- Numerical
Profile Id - Stable profile identity, interpreted within a model family’s declared catalog. The profile’s numerical ABI has a separate contract version.
Enums§
- KvStorage
Format - Versioned storage of causal K/V state, independent of activation arithmetic. INT8 uses a separate F32 scale for each K/V token and head. Its encoder first rounds to the existing F16 KV boundary, then uses max-abs / 127 and ties-even rounding to [-127, 127]. A zero vector has scale 1; non-finite input fails.
- Numerical
Execution Policy - A request, never proof that a numerical profile can execute on a device.
Requiremust fail if its complete declared program cannot be supported.