Skip to main content

EventProfiler

Struct EventProfiler 

Source
pub struct EventProfiler<A: EventApi> { /* private fields */ }
Expand description

Device profiling on the GPU’s own clock.

A profiling window is two events recorded into the stream where the window opened and closed. Nothing on the host waits for them: the device stamps each one as the queue reaches it, and the span between the two is read back later, by whoever awaits the measurement.

That deferral is what makes a measurement mean something when profiles nest. The system-time profiler has to drain the stream at both ends of every window to have anything to time, so an inner window’s two drains happen inside the outer one and are charged to it: the outer measurement grows with the number of inner ones, and every window reads back the launch latency the drain exposed rather than the work. Events are recorded in-queue and cost the host nothing, so an inner window measures its own kernels and the outer one measures the work rather than the profiling.

The state is the windows currently open, and the anchor that places them on the host clock.

Implementations§

Source§

impl<A: EventApi> EventProfiler<A>

Source

pub fn start( &mut self, stream: A::Stream, ) -> Result<ProfilingToken, ServerError>

Open a window at the current position of stream.

§Errors

ServerError when the device refuses an event or the stream will not record one. No window is opened and no token is issued, so the caller owes nothing; the events involved return to the pool.

Source

pub fn stop( &mut self, stream: A::Stream, token: ProfilingToken, ) -> Result<ProfileDuration, ProfileError>

Close the window token opened at the current position of stream.

Returns at enqueue time. The duration is read from the device by the returned future, which is where the wait for the window’s work lives.

That future blocks the thread that polls it: the device APIs offer no way to be woken when an event is reached, only a synchronize that parks the caller, so the first poll returns once the device has reached both events. Await it from a thread that can afford to wait — the same place a synchronize would have gone.

§Errors

ProfileError::NotRegistered for a token this profiler never issued or has already closed, the error registered against the window by failure when device work failed inside it, and ProfileError::Server when the closing event cannot be recorded. There is nothing to measure in any of those cases and the window is gone either way.

Source

pub fn abandon(&mut self, token: ProfilingToken)

Drop the window token opened without measuring it, for a caller that has no way to record its end.

Source

pub fn failure(&mut self, error: &ServerError)

Mark every open window invalid because device work failed.

This is what keeps a tuning candidate that failed from benchmarking at close to zero and winning the tune. A no-op with no window open, so a failure path calls it unconditionally and pays nothing for the common case of no measurement in flight.

Trait Implementations§

Source§

impl<A: EventApi> Debug for EventProfiler<A>

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<A: EventApi> Default for EventProfiler<A>

Source§

fn default() -> Self

Returns the “default value” for a type. Read more

Auto Trait Implementations§

§

impl<A> Freeze for EventProfiler<A>
where HashMap<ProfilingToken, Result<Open<A>, ProfileError>>: Freeze, EventPool<A>: Freeze, Option<Anchoring<A>>: Freeze,

§

impl<A> RefUnwindSafe for EventProfiler<A>
where HashMap<ProfilingToken, Result<Open<A>, ProfileError>>: RefUnwindSafe, EventPool<A>: RefUnwindSafe, Option<Anchoring<A>>: RefUnwindSafe,

§

impl<A> Send for EventProfiler<A>
where HashMap<ProfilingToken, Result<Open<A>, ProfileError>>: Send, EventPool<A>: Send, Option<Anchoring<A>>: Send,

§

impl<A> Sync for EventProfiler<A>
where HashMap<ProfilingToken, Result<Open<A>, ProfileError>>: Sync, EventPool<A>: Sync, Option<Anchoring<A>>: Sync,

§

impl<A> Unpin for EventProfiler<A>
where HashMap<ProfilingToken, Result<Open<A>, ProfileError>>: Unpin, EventPool<A>: Unpin, Option<Anchoring<A>>: Unpin,

§

impl<A> UnsafeUnpin for EventProfiler<A>
where HashMap<ProfilingToken, Result<Open<A>, ProfileError>>: UnsafeUnpin, EventPool<A>: UnsafeUnpin, Option<Anchoring<A>>: UnsafeUnpin,

§

impl<A> UnwindSafe for EventProfiler<A>
where HashMap<ProfilingToken, Result<Open<A>, ProfileError>>: UnwindSafe, EventPool<A>: UnwindSafe, Option<Anchoring<A>>: UnwindSafe,

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> Downcast for T
where T: Any,

Source§

fn into_any(self: Box<T>) -> Box<dyn Any>

Converts Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>, which can then be downcast into Box<dyn ConcreteType> where ConcreteType implements Trait.
Source§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Converts Rc<Trait> (where Trait: Downcast) to Rc<Any>, which can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
Source§

fn as_any(&self) -> &(dyn Any + 'static)

Converts &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
Source§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Converts &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
Source§

impl<T> DowncastSend for T
where T: Any + Send,

Source§

fn into_any_send(self: Box<T>) -> Box<dyn Any + Send>

Converts Box<Trait> (where Trait: DowncastSend) to Box<dyn Any + Send>, which can then be downcast into Box<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

Source§

fn into_any_sync(self: Box<T>) -> Box<dyn Any + Sync + Send>

Converts Box<Trait> (where Trait: DowncastSync) to Box<dyn Any + Send + Sync>, which can then be downcast into Box<ConcreteType> where ConcreteType implements Trait.
Source§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Sync + Send> ⓘ

Converts Arc<Trait> (where Trait: DowncastSync) to Arc<Any>, which can then be downcast into Arc<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> ErasedDestructor for T
where T: 'static,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more