Skip to main content

Module efficiency

Module efficiency 

Source
Expand description

Efficiency & Cost Tracking Module (ENT-008 through ENT-012)

Provides compute device abstraction, energy/cost metrics, model paradigm classification, platform efficiency tracking, and cost-performance benchmarking.

§Components

  • device - Compute device abstraction (CPU, GPU, TPU, Apple Silicon)
  • paradigm - Model paradigm classification (ML, DL, FineTuning, etc.)
  • metrics - Energy and cost metrics tracking
  • platform - Platform efficiency (server vs edge)
  • benchmark - Cost-performance benchmarking with Pareto analysis

Re-exports§

pub use benchmark::BenchmarkEntry;
pub use benchmark::BenchmarkStatistics;
pub use benchmark::CostPerformanceBenchmark;
pub use device::AppleSiliconInfo;
pub use device::ComputeDevice;
pub use device::CpuInfo;
pub use device::GpuInfo;
pub use device::SimdCapability;
pub use device::TpuInfo;
pub use metrics::pricing;
pub use metrics::CostMetrics;
pub use metrics::EfficiencyMetrics;
pub use metrics::EnergyMetrics;
pub use paradigm::FineTuneMethod;
pub use paradigm::ModelParadigm;
pub use platform::BudgetViolation;
pub use platform::EdgeEfficiency;
pub use platform::PlatformEfficiency;
pub use platform::ServerEfficiency;
pub use platform::WasmBudget;

Modules§

benchmark
Cost-Performance Benchmarking (ENT-011)
device
Compute Device Abstraction (ENT-008)
metrics
Energy and Cost Metrics (ENT-009)
paradigm
Model Paradigm Classification (ENT-010)
platform
Platform Efficiency (ENT-012)