Struct LocalTuner 

pub struct LocalTuner<AK: AutotuneKey, ID> { /* private fields */ }

A local tuner allows to create a tuner for a specific key that can be different from the server key.

Implementations

impl<AK, ID> LocalTuner<AK, ID>

where AK: AutotuneKey + 'static, ID: Hash + PartialEq + Eq + Clone + Display,

pub const fn new(name: &'static str) -> Self

Create a new local tuner.

pub fn init<I, Out, F>( &self, id: &ID, init_set: F, ) -> Arc<TunableSet<AK, I, Out>>

where F: Fn() -> TunableSet<AK, I, Out> + 'static + Send + Sync, I: TuneInputs, Out: AutotuneOutput,

Get or initialize the TunableSet for id.

Returns a cached Arc<TunableSet> keyed by the TypeId of init_set and by id, so the initializer runs once per device rather than once per process.

The device is part of the key because a set is routinely built from the device it will run on: a closure captures that device’s Client to ask what it supports, or reads its hardware properties to decide which tunables are worth offering at all. Keyed by the initializer alone, whichever device tuned first would answer those questions for every device that followed — promoting kernels onto hardware that cannot run them, or withholding kernels from hardware that can.

pub fn clear(&self)

Clear the autotune state.

pub fn execute<'a, I: TuneInputs, Out>( &self, id: &ID, client: &Client, operations: Arc<TunableSet<AK, I, Out>>, inputs: <I as TuneInputs>::At<'a>, ) -> Out

where <I as TuneInputs>::At<'a>: Clone + Send, Out: AutotuneOutput,

Execute the fastest operation in a TunableSet, triggering a tuning pass on the first call for a given key.