pub struct BufferPoolKey {
pub device: DeviceSpec,
pub dtype: DType,
pub size: usize,
}Expand description
Key for buffer pooling - groups buffers that can be reused interchangeably.
Buffer reuse is shape-agnostic: codegen reads logical shape from the UOp
graph, runtime dispatch passes raw *mut u8 pointers, and the planner
skips output buffers (the only consumers of Buffer::shape() via
as_array/as_array_mut). Two non-output buffers with the same
(device, dtype, rounded_size) are interchangeable storage regardless
of their logical shapes.
Fields§
§device: DeviceSpecDevice where buffer is allocated.
dtype: DTypeData type of buffer elements.
size: usizeBuffer size in bytes (rounded up to MIN_BLOCK_SIZE).
Trait Implementations§
Source§impl Clone for BufferPoolKey
impl Clone for BufferPoolKey
Source§fn clone(&self) -> BufferPoolKey
fn clone(&self) -> BufferPoolKey
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for BufferPoolKey
impl Debug for BufferPoolKey
Source§impl Hash for BufferPoolKey
impl Hash for BufferPoolKey
Source§impl PartialEq for BufferPoolKey
impl PartialEq for BufferPoolKey
Source§fn eq(&self, other: &BufferPoolKey) -> bool
fn eq(&self, other: &BufferPoolKey) -> bool
Tests for
self and other values to be equal, and is used by ==.impl Eq for BufferPoolKey
impl StructuralPartialEq for BufferPoolKey
Auto Trait Implementations§
impl Freeze for BufferPoolKey
impl RefUnwindSafe for BufferPoolKey
impl Send for BufferPoolKey
impl Sync for BufferPoolKey
impl Unpin for BufferPoolKey
impl UnsafeUnpin for BufferPoolKey
impl UnwindSafe for BufferPoolKey
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more