# Benchmarks
Domain **nonprofit** (FK-free, 6 entities), difficulty **medium**, seed **42**.
Measurements via the `dupehell` CLI binary (`target/release/dupehell.exe`),
single-thread. Machine: Lenovo ThinkPad P16 Gen 2 — Intel Core i7-13850HX
(20C/28T), 32 GB DDR5, SK Hynix 1 TB NVMe.
---
## Metrics
Post-hunt1407 (RAM/CPU pass, 2026-07-15): `FxHashSet` + `IdPools`-at-index
throughput fix, streaming `GtAccumulator` two-pass ground truth, bounded
FK/HN pools. Superseded numbers below (was: kyc, pre-hunt1407, max 75M).
| 10M | 10 150 014 | 15.0 s | 675 K | 871 MB |
| 25M | 25 375 015 | 40.8 s | 622 K | 1 937 MB |
| 50M | 50 750 012 | 78.4 s | 647 K | 3 260 MB |
| 75M | 76 125 016 | 119.3 s | 638 K | 4 840 MB |
| 100M | 101 500 013 | 159.4 s | 637 K | 6 420 MB |
| 150M | 152 250 014 | 245.4 s | 621 K | 9 260 MB |
| 200M | 203 000 015 | 317.8 s | 639 K | 12 499 MB |
| 250M | 253 750 016 | 359.7 s | 706 K | 15 583 MB |
| 300M | 304 500 017 | 468.5 s | 650 K | 18 552 MB |
---
## Observations
- **Throughput plateau**: stable ~620-706 K rec/s across the entire
10M-300M range — no degradation at scale, unlike the pre-hunt1407 numbers
(which already plateaued around 630 K by 75M, but with far higher RAM
cost extrapolated at scale)
- **RAM is now strictly linear**: ~62 MB per million records, confirmed up
to 300M (18.5 GB) — the original hunt1407 target was staying under 32 GB
at 200M (pre-fix estimate: 26-30 GB); actual measured value is **12.5 GB
at 200M**, more than 2x margin
- 350M+ not yet benchmarked
---
## Detailed per-domain results (hell, IPC)
40 domains, difficulty **hell**, format **IPC**. Wall time and throughput per domain. F1 max is the theoretical upper bound (deterministic).
Machine: Lenovo ThinkPad P16 Gen 2 — Intel Core i7-13850HX (20C/28T), 32 GB DDR5, SK Hynix 1 TB NVMe.
### 1M records per domain
| academia | 3.217 | 315,513 | 256.61 | 34.3 | 0.8181 | 0.9760 | 0.7042 |
| agriculture | 3.370 | 301,191 | 281.72 | 35.4 | 0.8117 | 0.9743 | 0.6957 |
| automotive | 3.285 | 308,985 | 270.66 | 36.5 | 0.8000 | 0.9689 | 0.6812 |
| aviation | 3.266 | 310,781 | 244.71 | 36.7 | 0.7817 | 0.9676 | 0.6557 |
| banking | 3.467 | 292,763 | 279.12 | 38.2 | 0.8199 | 0.9747 | 0.7075 |
| biotech | 3.297 | 307,859 | 247.43 | 37.7 | 0.8134 | 0.9720 | 0.6993 |
| blockchain | 3.666 | 276,871 | 346.61 | 38.2 | 0.8214 | 0.9738 | 0.7102 |
| construction | 3.316 | 306,095 | 259.67 | 38.3 | 0.8202 | 0.9724 | 0.7092 |
| crm | 3.566 | 284,633 | 290.44 | 39.0 | 0.8130 | 0.9739 | 0.6977 |
| cybersecurity | 3.323 | 305,450 | 238.20 | 39.3 | 0.8183 | 0.9766 | 0.7042 |
| ecommerce | 3.524 | 288,030 | 404.05 | 40.8 | 0.7962 | 0.9722 | 0.6742 |
| education | 3.427 | 296,181 | 272.78 | 41.5 | 0.8212 | 0.9752 | 0.7092 |
| energy | 3.353 | 302,717 | 278.36 | 169.2 | 0.8091 | 0.9730 | 0.6925 |
| fashion | 3.253 | 312,023 | 236.20 | 40.6 | 0.8231 | 0.9711 | 0.7143 |
| fintech | 3.468 | 292,678 | 342.08 | 172.3 | 0.8166 | 0.9753 | 0.7023 |
| food_beverage | 3.273 | 310,117 | 250.59 | 172.6 | 0.8191 | 0.9692 | 0.7092 |
| gaming | 3.711 | 273,513 | 286.61 | 173.1 | 0.8200 | 0.9717 | 0.7092 |
| healthcare | 3.552 | 285,758 | 376.85 | 177.3 | 0.8226 | 0.9793 | 0.7092 |
| hospitality | 3.389 | 299,502 | 303.35 | 179.8 | 0.8050 | 0.9762 | 0.6849 |
| hr | 3.416 | 297,135 | 305.73 | 180.0 | 0.8046 | 0.9751 | 0.6849 |
| insurance | 3.483 | 291,419 | 341.66 | 184.4 | 0.8190 | 0.9785 | 0.7042 |
| kyc | 3.769 | 269,304 | 316.68 | 194.8 | 0.8259 | 0.9789 | 0.7143 |
| legal | 3.443 | 294,804 | 346.97 | 43.7 | 0.8190 | 0.9785 | 0.7042 |
| logistics | 3.316 | 306,095 | 263.86 | 179.4 | 0.7937 | 0.9662 | 0.6734 |
| manufacturing | 3.939 | 257,682 | 264.96 | 184.3 | 0.8133 | 0.9661 | 0.7023 |
| maritime | 4.216 | 240,752 | 234.95 | 184.3 | 0.7947 | 0.9694 | 0.6734 |
| media | 3.758 | 270,093 | 253.98 | 183.9 | 0.8153 | 0.9717 | 0.7023 |
| mining | 3.426 | 296,267 | 231.60 | 184.0 | 0.8125 | 0.9694 | 0.6993 |
| nonprofit | 3.697 | 274,550 | 267.77 | 183.6 | 0.8217 | 0.9734 | 0.7109 |
| pharma | 4.148 | 244,701 | 283.17 | 184.2 | 0.8170 | 0.9729 | 0.7042 |
| publishing | 4.359 | 232,855 | 312.16 | 192.9 | 0.8199 | 0.9772 | 0.7062 |
| realestate | 4.500 | 225,559 | 359.85 | 192.9 | 0.8101 | 0.9758 | 0.6925 |
| renewable_energy | 4.398 | 230,789 | 249.83 | 192.8 | 0.8130 | 0.9707 | 0.6993 |
| retail | 4.280 | 237,152 | 262.88 | 192.8 | 0.8012 | 0.9725 | 0.6812 |
| social_media | 4.041 | 251,178 | 216.99 | 192.9 | 0.7958 | 0.9717 | 0.6739 |
| sports | 4.366 | 232,483 | 348.05 | 47.1 | 0.8024 | 0.9685 | 0.6849 |
| supplychain | 4.536 | 223,768 | 332.19 | 185.5 | 0.8223 | 0.9782 | 0.7092 |
| technology | 3.934 | 258,011 | 325.85 | 194.0 | 0.8175 | 0.9779 | 0.7023 |
| telecom | 3.408 | 297,832 | 306.74 | 193.4 | 0.7960 | 0.9732 | 0.6734 |
| travel | 3.340 | 303,896 | 252.46 | 193.5 | 0.8035 | 0.9717 | 0.6849 |
### 5M records per domain
| academia | 7.076 | 717,215 | 1283.89 | 36.2 | 0.8181 | 0.9759 | 0.7042 |
| agriculture | 7.991 | 635,091 | 1411.25 | 39.5 | 0.8117 | 0.9743 | 0.6957 |
| automotive | 7.569 | 670,500 | 1354.19 | 40.3 | 0.8000 | 0.9689 | 0.6812 |
| aviation | 6.844 | 741,527 | 1225.05 | 41.3 | 0.7817 | 0.9676 | 0.6557 |
| banking | 8.039 | 631,299 | 1393.99 | 42.7 | 0.8199 | 0.9747 | 0.7075 |
| biotech | 6.966 | 728,540 | 1236.61 | 367.1 | 0.8134 | 0.9720 | 0.6993 |
| blockchain | 8.545 | 593,916 | 1735.03 | 42.7 | 0.8214 | 0.9738 | 0.7102 |
| construction | 8.061 | 629,576 | 1300.99 | 407.7 | 0.8202 | 0.9724 | 0.7092 |
| crm | 10.467 | 484,858 | 1447.41 | 441.7 | 0.8129 | 0.9739 | 0.6977 |
| cybersecurity | 8.994 | 564,266 | 1192.54 | 457.9 | 0.8183 | 0.9766 | 0.7042 |
| ecommerce | 8.657 | 586,233 | 2019.28 | 469.3 | 0.7962 | 0.9722 | 0.6742 |
| education | 7.865 | 645,265 | 1367.08 | 48.4 | 0.8212 | 0.9752 | 0.7092 |
| energy | 7.542 | 672,900 | 1391.91 | 468.3 | 0.8091 | 0.9730 | 0.6925 |
| fashion | 7.173 | 707,516 | 1184.54 | 479.2 | 0.8231 | 0.9711 | 0.7143 |
| fintech | 8.550 | 593,569 | 1710.64 | 477.0 | 0.8165 | 0.9753 | 0.7022 |
| food_beverage | 7.468 | 679,568 | 1256.35 | 479.1 | 0.8191 | 0.9692 | 0.7092 |
| gaming | 7.934 | 639,653 | 1433.96 | 485.0 | 0.8199 | 0.9716 | 0.7092 |
| healthcare | 8.951 | 566,977 | 1886.78 | 507.2 | 0.8226 | 0.9793 | 0.7092 |
| hospitality | 8.031 | 631,928 | 1515.50 | 505.9 | 0.8050 | 0.9762 | 0.6849 |
| hr | 8.403 | 603,952 | 1531.23 | 515.1 | 0.8046 | 0.9751 | 0.6849 |
| insurance | 8.828 | 574,877 | 1711.02 | 520.5 | 0.8190 | 0.9785 | 0.7042 |
| kyc | 9.415 | 539,034 | 1582.46 | 52.9 | 0.8259 | 0.9789 | 0.7143 |
| legal | 8.018 | 632,953 | 1732.49 | 51.6 | 0.8190 | 0.9785 | 0.7042 |
| logistics | 7.221 | 702,813 | 1320.85 | 515.1 | 0.7937 | 0.9662 | 0.6734 |
| manufacturing | 7.615 | 666,450 | 1324.47 | 515.7 | 0.8133 | 0.9661 | 0.7022 |
| maritime | 7.976 | 636,285 | 1176.37 | 512.4 | 0.7947 | 0.9694 | 0.6734 |
| media | 9.345 | 543,072 | 1269.93 | 507.8 | 0.8153 | 0.9717 | 0.7022 |
| mining | 8.949 | 567,104 | 1157.43 | 53.7 | 0.8125 | 0.9694 | 0.6993 |
| nonprofit | 7.736 | 656,026 | 1337.26 | 476.9 | 0.8217 | 0.9734 | 0.7109 |
| pharma | 7.848 | 646,664 | 1414.14 | 483.4 | 0.8170 | 0.9729 | 0.7042 |
| publishing | 8.017 | 633,032 | 1560.88 | 506.5 | 0.8199 | 0.9772 | 0.7062 |
| realestate | 8.666 | 585,624 | 1799.85 | 506.9 | 0.8101 | 0.9758 | 0.6925 |
| renewable_energy | 7.544 | 672,722 | 1249.60 | 507.5 | 0.8130 | 0.9707 | 0.6993 |
| retail | 7.345 | 690,948 | 1315.05 | 53.4 | 0.8012 | 0.9725 | 0.6812 |
| social_media | 7.415 | 684,425 | 1084.86 | 479.0 | 0.7958 | 0.9716 | 0.6739 |
| sports | 8.000 | 634,378 | 1739.15 | 483.8 | 0.8024 | 0.9685 | 0.6849 |
| supplychain | 8.603 | 589,912 | 1663.80 | 511.4 | 0.8223 | 0.9782 | 0.7092 |
| technology | 8.302 | 611,300 | 1628.53 | 509.3 | 0.8175 | 0.9779 | 0.7022 |
| telecom | 8.169 | 621,253 | 1537.26 | 514.4 | 0.7960 | 0.9732 | 0.6734 |
| travel | 7.395 | 686,276 | 1264.12 | 54.6 | 0.8035 | 0.9717 | 0.6849 |
### 10M records per domain
| academia | 11.754 | 863,536 | 2562.63 | 38.0 | 0.8181 | 0.9759 | 0.7042 |
| agriculture | 13.194 | 769,290 | 2808.37 | 40.0 | 0.8117 | 0.9743 | 0.6957 |
| automotive | 12.912 | 786,092 | 2712.46 | 41.9 | 0.8000 | 0.9689 | 0.6812 |
| aviation | 13.017 | 779,750 | 2444.28 | 528.7 | 0.7817 | 0.9676 | 0.6557 |
| banking | 21.103 | 480,975 | 2790.84 | 43.4 | 0.8199 | 0.9747 | 0.7075 |
| biotech | 12.882 | 787,922 | 2472.05 | 580.3 | 0.8134 | 0.9720 | 0.6993 |
| blockchain | 16.883 | 601,197 | 3469.84 | 646.0 | 0.8214 | 0.9738 | 0.7102 |
| construction | 19.742 | 514,133 | 2590.48 | 46.5 | 0.8202 | 0.9724 | 0.7092 |
| crm | 16.073 | 631,494 | 2902.45 | 687.7 | 0.8129 | 0.9739 | 0.6977 |
| cybersecurity | 12.956 | 783,422 | 2382.22 | 726.7 | 0.8183 | 0.9766 | 0.7042 |
| ecommerce | 16.688 | 608,223 | 4033.75 | 47.9 | 0.7962 | 0.9722 | 0.6742 |
| education | 14.099 | 719,910 | 2724.32 | 768.7 | 0.8212 | 0.9752 | 0.7092 |
| energy | 23.002 | 441,266 | 2790.74 | 774.4 | 0.8091 | 0.9730 | 0.6925 |
| fashion | 12.178 | 833,471 | 2355.33 | 779.3 | 0.8231 | 0.9711 | 0.7143 |
| fintech | 15.940 | 636,764 | 3420.53 | 53.0 | 0.8165 | 0.9753 | 0.7022 |
| food_beverage | 14.792 | 686,183 | 2495.91 | 800.7 | 0.8191 | 0.9692 | 0.7092 |
| gaming | 21.024 | 482,782 | 2860.32 | 802.2 | 0.8199 | 0.9716 | 0.7092 |
| healthcare | 15.243 | 665,880 | 3768.37 | 821.2 | 0.8226 | 0.9793 | 0.7092 |
| hospitality | 15.817 | 641,715 | 3028.76 | 825.3 | 0.8050 | 0.9762 | 0.6849 |
| hr | 15.341 | 661,626 | 3054.95 | 57.6 | 0.8046 | 0.9751 | 0.6849 |
| insurance | 16.027 | 633,307 | 3414.16 | 842.1 | 0.8190 | 0.9785 | 0.7042 |
| kyc | 16.771 | 605,212 | 3171.09 | 883.0 | 0.8259 | 0.9789 | 0.7143 |
| legal | 16.223 | 625,656 | 3463.82 | 59.4 | 0.8190 | 0.9785 | 0.7042 |
| logistics | 13.742 | 738,612 | 2635.55 | 849.8 | 0.7937 | 0.9662 | 0.6734 |
| manufacturing | 23.614 | 429,830 | 2656.57 | 860.4 | 0.8133 | 0.9661 | 0.7022 |
| maritime | 13.454 | 754,423 | 2343.24 | 861.4 | 0.7947 | 0.9694 | 0.6734 |
| media | 13.487 | 752,577 | 2545.48 | 60.3 | 0.8153 | 0.9717 | 0.7022 |
| mining | 11.938 | 850,227 | 2310.66 | 857.3 | 0.8125 | 0.9694 | 0.6993 |
| nonprofit | 13.375 | 758,880 | 2666.46 | 852.9 | 0.8217 | 0.9734 | 0.7109 |
| pharma | 13.745 | 738,452 | 2824.59 | 59.8 | 0.8170 | 0.9729 | 0.7042 |
| publishing | 16.032 | 633,110 | 3125.59 | 852.8 | 0.8199 | 0.9772 | 0.7062 |
| realestate | 16.491 | 615,488 | 3603.67 | 864.3 | 0.8101 | 0.9758 | 0.6925 |
| renewable_energy | 13.737 | 738,881 | 2494.94 | 869.6 | 0.8130 | 0.9707 | 0.6993 |
| retail | 14.015 | 724,225 | 2640.63 | 64.1 | 0.8012 | 0.9725 | 0.6812 |
| social_media | 12.942 | 784,269 | 2170.87 | 62.4 | 0.7958 | 0.9716 | 0.6739 |
| sports | 15.359 | 660,852 | 3476.02 | 867.0 | 0.8024 | 0.9685 | 0.6849 |
| supplychain | 16.001 | 634,336 | 3312.27 | 62.8 | 0.8223 | 0.9782 | 0.7092 |
| technology | 15.798 | 642,487 | 3266.78 | 877.4 | 0.8175 | 0.9779 | 0.7022 |
| telecom | 15.476 | 655,855 | 3065.84 | 882.0 | 0.7960 | 0.9732 | 0.6734 |
| travel | 13.518 | 750,852 | 2522.26 | 884.3 | 0.8035 | 0.9717 | 0.6849 |
### 20M records per domain
| academia | 21.601 | 939,772 | 5125.25 | 42.0 | 0.8181 | 0.9759 | 0.7042 |
| agriculture | 23.938 | 848,025 | 5622.39 | 47.7 | 0.8117 | 0.9743 | 0.6957 |
| automotive | 23.877 | 850,191 | 5418.29 | 982.1 | 0.8000 | 0.9689 | 0.6812 |
| aviation | 22.605 | 898,032 | 4891.82 | 50.4 | 0.7817 | 0.9676 | 0.6557 |
| banking | 26.364 | 769,990 | 5577.97 | 1106.2 | 0.8199 | 0.9747 | 0.7075 |
| biotech | 24.673 | 822,762 | 4949.77 | 55.3 | 0.8134 | 0.9720 | 0.6993 |
| blockchain | 28.143 | 721,317 | 6934.42 | 1205.7 | 0.8214 | 0.9738 | 0.7102 |
| construction | 25.124 | 807,993 | 5190.69 | 57.6 | 0.8202 | 0.9724 | 0.7092 |
| crm | 28.969 | 700,749 | 5816.24 | 62.7 | 0.8129 | 0.9739 | 0.6977 |
| cybersecurity | 24.873 | 816,147 | 4763.65 | 1353.5 | 0.8183 | 0.9766 | 0.7042 |
| ecommerce | 30.592 | 663,573 | 8062.42 | 62.5 | 0.7962 | 0.9722 | 0.6742 |
| education | 27.064 | 750,074 | 5449.08 | 1370.0 | 0.8212 | 0.9752 | 0.7092 |
| energy | 27.421 | 740,309 | 5570.25 | 64.2 | 0.8091 | 0.9730 | 0.6925 |
| fashion | 25.211 | 805,205 | 4717.26 | 1411.1 | 0.8231 | 0.9711 | 0.7143 |
| fintech | 29.005 | 699,880 | 6835.86 | 67.9 | 0.8165 | 0.9753 | 0.7022 |
| food_beverage | 25.765 | 787,891 | 5001.57 | 1440.7 | 0.8191 | 0.9692 | 0.7092 |
| gaming | 27.477 | 738,800 | 5731.76 | 70.9 | 0.8199 | 0.9716 | 0.7092 |
| healthcare | 31.188 | 650,892 | 7530.80 | 70.6 | 0.8226 | 0.9793 | 0.7092 |
| hospitality | 29.111 | 697,331 | 6057.98 | 70.8 | 0.8050 | 0.9762 | 0.6849 |
| hr | 27.946 | 726,401 | 6119.94 | 1484.2 | 0.8046 | 0.9751 | 0.6849 |
| insurance | 30.738 | 660,421 | 6834.26 | 72.6 | 0.8190 | 0.9785 | 0.7042 |
| kyc | 34.599 | 586,722 | 6338.86 | 1587.3 | 0.8259 | 0.9789 | 0.7143 |
| legal | 30.238 | 671,341 | 6930.86 | 75.5 | 0.8190 | 0.9785 | 0.7042 |
| logistics | 27.238 | 745,283 | 5277.31 | 73.3 | 0.7937 | 0.9662 | 0.6734 |
| manufacturing | 29.222 | 694,683 | 5305.19 | 74.9 | 0.8133 | 0.9661 | 0.7022 |
| maritime | 25.744 | 788,534 | 4694.40 | 1590.1 | 0.7947 | 0.9694 | 0.6734 |
| media | 25.920 | 783,179 | 5080.09 | 75.8 | 0.8153 | 0.9717 | 0.7022 |
| mining | 25.485 | 796,547 | 4625.09 | 1595.3 | 0.8125 | 0.9694 | 0.6993 |
| nonprofit | 27.216 | 745,885 | 5334.65 | 75.8 | 0.8217 | 0.9734 | 0.7109 |
| pharma | 27.143 | 747,891 | 5647.16 | 74.2 | 0.8170 | 0.9729 | 0.7042 |
| publishing | 29.727 | 682,881 | 6242.40 | 74.9 | 0.8199 | 0.9772 | 0.7062 |
| realestate | 30.208 | 672,008 | 7202.24 | 74.1 | 0.8101 | 0.9758 | 0.6925 |
| renewable_energy | 26.351 | 770,370 | 4996.22 | 1562.4 | 0.8129 | 0.9707 | 0.6993 |
| retail | 26.616 | 762,700 | 5260.27 | 76.7 | 0.8012 | 0.9725 | 0.6812 |
| social_media | 24.933 | 814,183 | 4337.08 | 1587.6 | 0.7958 | 0.9716 | 0.6739 |
| sports | 28.265 | 718,203 | 6950.36 | 76.1 | 0.8024 | 0.9685 | 0.6849 |
| supplychain | 30.002 | 676,622 | 6628.78 | 1577.5 | 0.8223 | 0.9782 | 0.7092 |
| technology | 30.560 | 664,268 | 6523.61 | 74.9 | 0.8175 | 0.9779 | 0.7022 |
| telecom | 29.389 | 690,735 | 6135.21 | 1567.7 | 0.7960 | 0.9732 | 0.6734 |
| travel | 26.959 | 752,996 | 5045.74 | 76.5 | 0.8035 | 0.9717 | 0.6849 |