Expand description
Typed execution-policy and admission authority contracts.
Structs§
- Executor
Admission Limits - Immutable admission ceilings compiled into one model executor.
- Executor
Admission Snapshot - Runtime-owned admission state exposed to product health and validators.
Enums§
- Attention
Execution Policy - Product policy for selecting an attention provider implementation.
- Execution
Resource Authority - Declares the authoritative owner of request-lifetime accelerator resources.
Constants§
- CUDA_
NATIVE_ ADAPTIVE_ V1_ MAX_ SEQUENCE_ TOKENS - Current CUDA native-adaptive boundary between single- and multi-partition addressed decode. The compiled provider and effective-config report consume this same constant.