pub struct AttentionBenchmarkResult {
pub naive_time_ms: f64,
pub flash_time_ms: f64,
pub speedup: f64,
pub memory_reduction: f64,
pub num_queries: usize,
pub dimensions: usize,
}Expand description
Result of a benchmark comparing naive vs flash attention.
Fields§
§naive_time_ms: f64Naive attention time in milliseconds.
flash_time_ms: f64Flash attention time in milliseconds.
speedup: f64Speedup ratio (naive / flash).
memory_reduction: f64Memory reduction ratio (0.75 = 75% less memory).
num_queries: usizeNumber of query vectors.
dimensions: usizeEmbedding dimension.
Trait Implementations§
Source§impl Clone for BenchmarkResult
impl Clone for BenchmarkResult
Source§fn clone(&self) -> BenchmarkResult
fn clone(&self) -> BenchmarkResult
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for BenchmarkResult
impl Debug for BenchmarkResult
Source§impl<'de> Deserialize<'de> for BenchmarkResult
impl<'de> Deserialize<'de> for BenchmarkResult
Source§fn deserialize<__D>(
__deserializer: __D,
) -> Result<BenchmarkResult, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(
__deserializer: __D,
) -> Result<BenchmarkResult, <__D as Deserializer<'de>>::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Display for BenchmarkResult
impl Display for BenchmarkResult
Source§impl Serialize for BenchmarkResult
impl Serialize for BenchmarkResult
Source§fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
fn serialize<__S>(
&self,
__serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
__S: Serializer,
Serialize this value into the given Serde serializer. Read more
Auto Trait Implementations§
impl Freeze for BenchmarkResult
impl RefUnwindSafe for BenchmarkResult
impl Send for BenchmarkResult
impl Sync for BenchmarkResult
impl Unpin for BenchmarkResult
impl UnsafeUnpin for BenchmarkResult
impl UnwindSafe for BenchmarkResult
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more