register_sequence_threshold_provider

Function register_sequence_threshold_provider 

Source
pub fn register_sequence_threshold_provider(provider: fn() -> Option<usize>)
Expand description

Register a callback that exposes the current sequence length threshold derived from the auto-offload planner. Array constructors can use this hint to decide when to prefer GPU residency automatically.