Expand description
Distribution comparison: “is candidate slower than baseline?”
Behind the compare Cargo feature (on by default).
Functions§
- cohens_
d - Cohen’s d effect size: standardised difference between two means.
Magnitude
< 0.2is small,~ 0.5medium,> 0.8large. Use alongsideks_statisticto decide whether a p99 regression is “real” or noise. - ks_
statistic - Two-sample Kolmogorov-Smirnov D statistic: the maximum vertical
gap between the two empirical CDFs. Range
[0.0, 1.0]; larger means more different.Noneif either side is empty.