pub struct RooflineCeiling {
pub model_bytes: f64,
pub bw_ceiling: f64,
pub compute_ceiling: f64,
pub throughput_ceiling: f64,
pub bottleneck: Bottleneck,
pub contract_id: String,
}Expand description
Performance ceilings derived from the roofline contract.
Fields§
§model_bytes: f64Model size in bytes
bw_ceiling: f64Bandwidth-limited ceiling (tokens/sec)
compute_ceiling: f64Compute-limited ceiling (tokens/sec)
throughput_ceiling: f64Effective ceiling: min(bw, compute)
bottleneck: BottleneckWhether bandwidth-bound or compute-bound
contract_id: StringSource contract ID
Trait Implementations§
Source§impl Clone for RooflineCeiling
impl Clone for RooflineCeiling
Source§fn clone(&self) -> RooflineCeiling
fn clone(&self) -> RooflineCeiling
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for RooflineCeiling
impl RefUnwindSafe for RooflineCeiling
impl Send for RooflineCeiling
impl Sync for RooflineCeiling
impl Unpin for RooflineCeiling
impl UnsafeUnpin for RooflineCeiling
impl UnwindSafe for RooflineCeiling
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more