Skip to main content

HybridDispatcher

Struct HybridDispatcher 

Source
pub struct HybridDispatcher { /* private fields */ }
Expand description

Dispatcher for routing workloads between CPU and GPU.

The dispatcher uses the configured ProcessingMode to decide where to execute each workload. In Adaptive mode, it learns the optimal threshold from runtime measurements.

Implementations§

Source§

impl HybridDispatcher

Source

pub fn new(config: HybridConfig) -> Self

Creates a new hybrid dispatcher.

Source

pub fn with_defaults() -> Self

Creates a dispatcher with default configuration.

Source

pub fn should_use_gpu(&self, workload_size: usize) -> bool

Returns whether GPU should be used for the given workload size.

Source

pub fn execute<W: HybridWorkload>( &self, workload: &W, ) -> HybridResult<W::Result>

Executes a workload using the appropriate backend.

Returns the result and records execution statistics.

Source

pub fn execute_measured<W: HybridWorkload>( &self, workload: &W, ) -> HybridResult<W::Result>
where W::Result: Clone,

Executes a workload and measures both backends for comparison.

In Adaptive mode, this updates the threshold based on measurements. Returns the result from the faster backend.

Source

pub fn update_adaptive_threshold( &self, _workload_size: usize, cpu_time: Duration, gpu_time: Duration, )

Updates the adaptive threshold based on runtime measurements.

Source

pub fn execute_cpu<W: HybridWorkload>(&self, workload: &W) -> W::Result

Forces execution on CPU regardless of mode.

Source

pub fn execute_gpu<W: HybridWorkload>( &self, workload: &W, ) -> HybridResult<W::Result>

Forces execution on GPU regardless of mode.

Source

pub fn config(&self) -> &HybridConfig

Returns the configuration.

Source

pub fn stats(&self) -> &HybridStats

Returns the execution statistics.

Source

pub fn stats_arc(&self) -> Arc<HybridStats>

Returns a shared reference to the statistics.

Source

pub fn adaptive_threshold(&self) -> usize

Returns the current adaptive threshold.

Source

pub fn set_adaptive_threshold(&self, threshold: usize)

Manually sets the adaptive threshold.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> ArchivePointee for T

Source§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
Source§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<F, W, T, D> Deserialize<With<T, W>, D> for F
where W: DeserializeWith<F, T, D>, D: Fallible + ?Sized, F: ?Sized,

Source§

fn deserialize( &self, deserializer: &mut D, ) -> Result<With<T, W>, <D as Fallible>::Error>

Deserializes using the given deserializer
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> LayoutRaw for T

Source§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Gets the layout of the type.
Source§

impl<T> Pointee for T

Source§

type Metadata = ()

The type for metadata in pointers and references to Self.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more