Skip to main content

Module numerical

Module numerical 

Source
Expand description

User-requested numerical execution policy. Device capabilities and model family contracts resolve this request before any model execution begins.

Structs§

NumericalProfileId
Stable profile identity, interpreted within a model family’s declared catalog. The profile’s numerical ABI has a separate contract version.

Enums§

KvStorageFormat
Versioned storage of causal K/V state, independent of activation arithmetic. INT8 uses a separate F32 scale for each K/V token and head. Its encoder first rounds to the existing F16 KV boundary, then uses max-abs / 127 and ties-even rounding to [-127, 127]. A zero vector has scale 1; non-finite input fails.
NumericalExecutionPolicy
A request, never proof that a numerical profile can execute on a device. Require must fail if its complete declared program cannot be supported.