pub struct Tuner<K: AutotuneKey> { /* private fields */ }Expand description
Runs autotune benchmarks for a single device and caches the results.
On wasm, tune spawns its work on the browser event loop; elsewhere
it blocks inline. Either way the benchmarking itself is synchronous; only the
per-sample profile resolution is awaited.
Implementations§
Source§impl<K: AutotuneKey> Tuner<K>
impl<K: AutotuneKey> Tuner<K>
Sourcepub fn new(name: &str, device_id: &str) -> Self
pub fn new(name: &str, device_id: &str) -> Self
Create a tuner. Its cache is seeded from the persistent on-disk cache when
std_io is enabled.
Sourcepub fn fastest(&self, key: &K) -> TuneCacheResult
pub fn fastest(&self, key: &K) -> TuneCacheResult
Fetch the fastest autotune operation index for an autotune key.
Sourcepub fn check_tune<'a, R: Runtime, F: TuneInputs, Out: AutotuneOutput>(
&self,
key: &K,
inputs: &F::At<'a>,
tunables: &TunableSet<K, F, Out>,
checksum: impl FnOnce() -> String + Send + Sync,
client: &ComputeClient<R>,
) -> TuneCacheResult
pub fn check_tune<'a, R: Runtime, F: TuneInputs, Out: AutotuneOutput>( &self, key: &K, inputs: &F::At<'a>, tunables: &TunableSet<K, F, Out>, checksum: impl FnOnce() -> String + Send + Sync, client: &ComputeClient<R>, ) -> TuneCacheResult
Check the cache, validate checksums if needed, and kick off a tuning job if the key is a miss. Returns the resolved cache state.
Trait Implementations§
Auto Trait Implementations§
impl<K> Freeze for Tuner<K>
impl<K> !RefUnwindSafe for Tuner<K>
impl<K> Send for Tuner<K>
impl<K> Sync for Tuner<K>
impl<K> Unpin for Tuner<K>
impl<K> UnsafeUnpin for Tuner<K>
impl<K> !UnwindSafe for Tuner<K>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more