testlint 0.1.0

A comprehensive toolkit for profiling and coverage reporting across multiple programming languages
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
   Compiling multi_lang_profiler v0.1.0 (/Users/danielphang/IdeaProjects/intellivue-sdk)
    Finished `bench` profile [optimized] target(s) in 8.03s
     Running unittests src/lib.rs (target/release/deps/intellivue_sdk-67d6eaaf89fc608a)

running 80 tests
test platform::tests::test_get_process_name_current ... ignored
test platform::tests::test_process_exists_current ... ignored
test platform::tests::test_process_exists_invalid ... ignored
test profiler::cpp::tests::test_profiler_default ... ignored
test profiler::cpp::tests::test_profiler_new ... ignored
test profiler::csharp::tests::test_profiler_default ... ignored
test profiler::csharp::tests::test_profiler_new ... ignored
test profiler::go::tests::test_go_profiler_default ... ignored
test profiler::go::tests::test_go_profiler_new ... ignored
test profiler::java::tests::test_profiler_default ... ignored
test profiler::java::tests::test_profiler_new ... ignored
test profiler::php::tests::test_profiler_default ... ignored
test profiler::php::tests::test_profiler_new ... ignored
test profiler::python::tests::test_function_location_creation ... ignored
test profiler::python::tests::test_py_coverage_data_structure ... ignored
test profiler::python::tests::test_python_profiler_default ... ignored
test profiler::python::tests::test_python_profiler_new ... ignored
test profiler::ruby::tests::test_profiler_default ... ignored
test profiler::ruby::tests::test_profiler_new ... ignored
test profiler::rust::tests::test_profiler_default ... ignored
test profiler::rust::tests::test_profiler_new ... ignored
test profiler::typescript::tests::test_profiler_default ... ignored
test profiler::typescript::tests::test_profiler_new ... ignored
test reporter::tests::test_buffer_overflow_discards_oldest ... ignored
test reporter::tests::test_reporter_config_defaults ... ignored
test reporter::tests::test_reporter_config_from_args ... ignored
test reporter::tests::test_reporter_disabled_by_default ... ignored
test runtime_coverage::cpp::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::cpp::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::csharp::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::csharp::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::go::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::go::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::java::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::java::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::javascript::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::javascript::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::php::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::php::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::python::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::python::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::ruby::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::ruby::tests::test_runtime_coverage_new ... ignored
test runtime_coverage::rust::tests::test_runtime_coverage_default ... ignored
test runtime_coverage::rust::tests::test_runtime_coverage_new ... ignored
test test_orchestrator::cpp::tests::test_cpp_non_test_file_patterns ... ignored
test test_orchestrator::cpp::tests::test_cpp_test_file_pattern_detection ... ignored
test test_orchestrator::cpp::tests::test_detect_cpp_test_files ... ignored
test test_orchestrator::csharp::tests::test_csharp_non_test_file_patterns ... ignored
test test_orchestrator::csharp::tests::test_csharp_test_file_pattern_detection ... ignored
test test_orchestrator::csharp::tests::test_detect_csharp_test_files_heuristic ... ignored
test test_orchestrator::java::tests::test_detect_java_test_files_heuristic ... ignored
test test_orchestrator::java::tests::test_java_file_to_jacoco_pattern_gradle ... ignored
test test_orchestrator::java::tests::test_java_file_to_jacoco_pattern_maven ... ignored
test test_orchestrator::java::tests::test_java_non_test_file_patterns ... ignored
test test_orchestrator::java::tests::test_java_test_file_pattern_detection ... ignored
test test_orchestrator::javascript::tests::test_detect_javascript_test_files_heuristic_patterns ... ignored
test test_orchestrator::javascript::tests::test_javascript_non_test_file_patterns ... ignored
test test_orchestrator::javascript::tests::test_javascript_test_file_pattern_detection ... ignored
test test_orchestrator::javascript::tests::test_nyc_exclude_patterns_with_detected_tests ... ignored
test test_orchestrator::php::tests::test_detect_php_test_files_heuristic ... ignored
test test_orchestrator::php::tests::test_php_non_test_file_patterns ... ignored
test test_orchestrator::php::tests::test_php_test_file_pattern_detection ... ignored
test test_orchestrator::python::tests::test_build_python_omit_patterns_format ... ignored
test test_orchestrator::python::tests::test_build_python_omit_patterns_no_duplicates ... ignored
test test_orchestrator::python::tests::test_build_python_omit_patterns_with_custom_patterns ... ignored
test test_orchestrator::python::tests::test_build_python_omit_patterns_with_empty_config ... ignored
test test_orchestrator::python::tests::test_python_specific_patterns_exclude_dependencies_not_tests ... ignored
test test_orchestrator::ruby::tests::test_detect_ruby_test_files_heuristic ... ignored
test test_orchestrator::ruby::tests::test_ruby_non_test_file_patterns ... ignored
test test_orchestrator::ruby::tests::test_ruby_test_file_pattern_detection ... ignored
test test_orchestrator::tests::test_default_config ... ignored
test test_orchestrator::tests::test_orchestrator_creation ... ignored
test test_uploader::tests::test_config_auto_detects_git_info ... ignored
test test_uploader::tests::test_config_default ... ignored
test test_uploader::tests::test_config_explicit_git_info_overrides_detection ... ignored
test test_uploader::tests::test_config_from_args ... ignored
test test_uploader::tests::test_git_branch_detection ... ignored
test test_uploader::tests::test_git_commit_detection ... ignored
test test_uploader::tests::test_tarball_integrity ... ignored

test result: ok. 0 passed; 0 failed; 80 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src/bin/browser_coverage.rs (target/release/deps/browser_coverage-abd9277bcd3032ce)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src/main.rs (target/release/deps/profiler-6f37fb6b5a53fa80)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src/bin/run_with_coverage.rs (target/release/deps/run_with_coverage-0c75d244bb1b6f3e)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src/bin/runtime_coverage.rs (target/release/deps/runtime_coverage-9d98936a5f4c285d)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running unittests src/bin/upload_coverage.rs (target/release/deps/upload_coverage-a68aaabc7a7bf0f8)

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

     Running benches/json_parsing_bench.rs (target/release/deps/json_parsing_bench-2c3eaba7ea4e01ed)
Gnuplot not found, using plotters backend
Benchmarking jest_json_parsing/parse/10_tests
Benchmarking jest_json_parsing/parse/10_tests: Warming up for 3.0000 s
Benchmarking jest_json_parsing/parse/10_tests: Collecting 100 samples in estimated 5.0036 s (2.9M iterations)
Benchmarking jest_json_parsing/parse/10_tests: Analyzing
jest_json_parsing/parse/10_tests
                        time:   [2.5357 µs 3.0226 µs 3.4933 µs]
                        change: [+100.27% +146.11% +193.58%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild
Benchmarking jest_json_parsing/parse/100_tests
Benchmarking jest_json_parsing/parse/100_tests: Warming up for 3.0000 s
Benchmarking jest_json_parsing/parse/100_tests: Collecting 100 samples in estimated 5.1387 s (162k iterations)
Benchmarking jest_json_parsing/parse/100_tests: Analyzing
jest_json_parsing/parse/100_tests
                        time:   [7.5319 µs 8.4372 µs 9.6565 µs]
                        change: [+39.366% +80.710% +135.36%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 19 outliers among 100 measurements (19.00%)
  4 (4.00%) high mild
  15 (15.00%) high severe
Benchmarking jest_json_parsing/parse/1000_tests
Benchmarking jest_json_parsing/parse/1000_tests: Warming up for 3.0000 s
Benchmarking jest_json_parsing/parse/1000_tests: Collecting 100 samples in estimated 5.2353 s (86k iterations)
Benchmarking jest_json_parsing/parse/1000_tests: Analyzing
jest_json_parsing/parse/1000_tests
                        time:   [60.332 µs 60.486 µs 60.673 µs]
                        change: [-0.5030% -0.0343% +0.4264%] (p = 0.88 > 0.05)
                        No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high mild

Benchmarking mocha_json_parsing/parse/10_tests
Benchmarking mocha_json_parsing/parse/10_tests: Warming up for 3.0000 s
Benchmarking mocha_json_parsing/parse/10_tests: Collecting 100 samples in estimated 5.0077 s (1.5M iterations)
Benchmarking mocha_json_parsing/parse/10_tests: Analyzing
mocha_json_parsing/parse/10_tests
                        time:   [3.2098 µs 3.2253 µs 3.2456 µs]
                        change: [-4.4241% -3.3238% -2.3002%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  1 (1.00%) low mild
  1 (1.00%) high mild
  5 (5.00%) high severe
Benchmarking mocha_json_parsing/parse/100_tests
Benchmarking mocha_json_parsing/parse/100_tests: Warming up for 3.0000 s
Benchmarking mocha_json_parsing/parse/100_tests: Collecting 100 samples in estimated 5.1370 s (177k iterations)
Benchmarking mocha_json_parsing/parse/100_tests: Analyzing
mocha_json_parsing/parse/100_tests
                        time:   [28.856 µs 29.301 µs 29.982 µs]
                        change: [-2.0167% -0.9029% +0.5635%] (p = 0.22 > 0.05)
                        No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
  1 (1.00%) low mild
  1 (1.00%) high mild
  3 (3.00%) high severe
Benchmarking mocha_json_parsing/parse/1000_tests
Benchmarking mocha_json_parsing/parse/1000_tests: Warming up for 3.0000 s
Benchmarking mocha_json_parsing/parse/1000_tests: Collecting 100 samples in estimated 5.9708 s (20k iterations)
Benchmarking mocha_json_parsing/parse/1000_tests: Analyzing
mocha_json_parsing/parse/1000_tests
                        time:   [290.86 µs 291.91 µs 293.36 µs]
                        change: [-6.9506% -5.0766% -3.7870%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  5 (5.00%) high mild
  2 (2.00%) high severe

Benchmarking rspec_json_parsing/parse/10_tests
Benchmarking rspec_json_parsing/parse/10_tests: Warming up for 3.0000 s
Benchmarking rspec_json_parsing/parse/10_tests: Collecting 100 samples in estimated 5.0059 s (1.2M iterations)
Benchmarking rspec_json_parsing/parse/10_tests: Analyzing
rspec_json_parsing/parse/10_tests
                        time:   [4.1757 µs 4.1855 µs 4.1964 µs]
                        change: [-5.2434% -4.4159% -3.7214%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) low mild
  5 (5.00%) high mild
Benchmarking rspec_json_parsing/parse/100_tests
Benchmarking rspec_json_parsing/parse/100_tests: Warming up for 3.0000 s
Benchmarking rspec_json_parsing/parse/100_tests: Collecting 100 samples in estimated 5.1412 s (131k iterations)
Benchmarking rspec_json_parsing/parse/100_tests: Analyzing
rspec_json_parsing/parse/100_tests
                        time:   [39.280 µs 39.462 µs 39.688 µs]
                        change: [-3.1135% -2.6267% -2.0677%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  2 (2.00%) high severe
Benchmarking rspec_json_parsing/parse/1000_tests
Benchmarking rspec_json_parsing/parse/1000_tests: Warming up for 3.0000 s
Benchmarking rspec_json_parsing/parse/1000_tests: Collecting 100 samples in estimated 6.7000 s (15k iterations)
Benchmarking rspec_json_parsing/parse/1000_tests: Analyzing
rspec_json_parsing/parse/1000_tests
                        time:   [438.05 µs 445.87 µs 461.50 µs]
                        change: [-2.9611% -2.0710% -0.6312%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe

Benchmarking json_serialization/serialize_coverage_summary
Benchmarking json_serialization/serialize_coverage_summary: Warming up for 3.0000 s
Benchmarking json_serialization/serialize_coverage_summary: Collecting 100 samples in estimated 5.0301 s (444k iterations)
Benchmarking json_serialization/serialize_coverage_summary: Analyzing
json_serialization/serialize_coverage_summary
                        time:   [11.205 µs 11.269 µs 11.345 µs]
                        change: [+0.3509% +1.0061% +1.7253%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 13 outliers among 100 measurements (13.00%)
  4 (4.00%) low mild
  4 (4.00%) high mild
  5 (5.00%) high severe

     Running benches/tarball_bench.rs (target/release/deps/tarball_bench-5706d250a67c8601)
Gnuplot not found, using plotters backend
Benchmarking tarball_creation/single_file/10kb
Benchmarking tarball_creation/single_file/10kb: Warming up for 3.0000 s
Benchmarking tarball_creation/single_file/10kb: Collecting 100 samples in estimated 7.1296 s (15k iterations)
Benchmarking tarball_creation/single_file/10kb: Analyzing
tarball_creation/single_file/10kb
                        time:   [374.70 µs 381.57 µs 389.50 µs]
                        change: [+0.2859% +4.4138% +8.2952%] (p = 0.02 < 0.05)
                        Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  1 (1.00%) high severe
Benchmarking tarball_creation/single_file/100kb
Benchmarking tarball_creation/single_file/100kb: Warming up for 3.0000 s
Benchmarking tarball_creation/single_file/100kb: Collecting 100 samples in estimated 5.1320 s (10k iterations)
Benchmarking tarball_creation/single_file/100kb: Analyzing
tarball_creation/single_file/100kb
                        time:   [501.93 µs 522.08 µs 547.93 µs]
                        change: [+10.673% +14.848% +19.887%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  3 (3.00%) high mild
  4 (4.00%) high severe
Benchmarking tarball_creation/single_file/1000kb
Benchmarking tarball_creation/single_file/1000kb: Warming up for 3.0000 s

Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.0s, enable flat sampling, or reduce sample count to 50.
Benchmarking tarball_creation/single_file/1000kb: Collecting 100 samples in estimated 9.0156 s (5050 iterations)
Benchmarking tarball_creation/single_file/1000kb: Analyzing
tarball_creation/single_file/1000kb
                        time:   [1.6681 ms 1.6935 ms 1.7247 ms]
                        change: [-0.7828% +1.8334% +4.2862%] (p = 0.16 > 0.05)
                        No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
  3 (3.00%) low mild
  3 (3.00%) high mild
  2 (2.00%) high severe

Benchmarking compression_levels/level/fast
Benchmarking compression_levels/level/fast: Warming up for 3.0000 s
Benchmarking compression_levels/level/fast: Collecting 100 samples in estimated 5.2698 s (15k iterations)
Benchmarking compression_levels/level/fast: Analyzing
compression_levels/level/fast
                        time:   [344.45 µs 350.34 µs 357.70 µs]
                        change: [-7.4248% -4.9280% -2.2812%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 17 outliers among 100 measurements (17.00%)
  6 (6.00%) low mild
  6 (6.00%) high mild
  5 (5.00%) high severe
Benchmarking compression_levels/level/default
Benchmarking compression_levels/level/default: Warming up for 3.0000 s
Benchmarking compression_levels/level/default: Collecting 100 samples in estimated 6.8686 s (15k iterations)
Benchmarking compression_levels/level/default: Analyzing
compression_levels/level/default
                        time:   [430.37 µs 435.61 µs 442.01 µs]
                        change: [-10.791% -7.8305% -5.0073%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
  2 (2.00%) low mild
  2 (2.00%) high mild
  4 (4.00%) high severe
Benchmarking compression_levels/level/best
Benchmarking compression_levels/level/best: Warming up for 3.0000 s
Benchmarking compression_levels/level/best: Collecting 100 samples in estimated 6.6574 s (15k iterations)
Benchmarking compression_levels/level/best: Analyzing
compression_levels/level/best
                        time:   [438.08 µs 445.73 µs 454.33 µs]
                        change: [-5.7703% -3.7477% -1.6168%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  3 (3.00%) high severe

Benchmarking compression_ratio/realistic_json/fast
Benchmarking compression_ratio/realistic_json/fast: Warming up for 3.0000 s
Benchmarking compression_ratio/realistic_json/fast: Collecting 100 samples in estimated 6.2927 s (20k iterations)
Benchmarking compression_ratio/realistic_json/fast: Analyzing
compression_ratio/realistic_json/fast
                        time:   [303.51 µs 308.95 µs 314.89 µs]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe
Benchmarking compression_ratio/realistic_json/default
Benchmarking compression_ratio/realistic_json/default: Warming up for 3.0000 s
Benchmarking compression_ratio/realistic_json/default: Collecting 100 samples in estimated 6.6484 s (20k iterations)
Benchmarking compression_ratio/realistic_json/default: Analyzing
compression_ratio/realistic_json/default
                        time:   [321.86 µs 325.42 µs 329.25 µs]
Found 10 outliers among 100 measurements (10.00%)
  4 (4.00%) low mild
  3 (3.00%) high mild
  3 (3.00%) high severe
Benchmarking compression_ratio/realistic_json/best
Benchmarking compression_ratio/realistic_json/best: Warming up for 3.0000 s
Benchmarking compression_ratio/realistic_json/best: Collecting 100 samples in estimated 5.2105 s (15k iterations)
Benchmarking compression_ratio/realistic_json/best: Analyzing
compression_ratio/realistic_json/best
                        time:   [332.62 µs 337.42 µs 344.06 µs]
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) low mild
  4 (4.00%) high mild
  1 (1.00%) high severe

Benchmarking multiple_files_tarball/files/10
Benchmarking multiple_files_tarball/files/10: Warming up for 3.0000 s
Benchmarking multiple_files_tarball/files/10: Collecting 100 samples in estimated 8.6198 s (10k iterations)
Benchmarking multiple_files_tarball/files/10: Analyzing
multiple_files_tarball/files/10
                        time:   [873.42 µs 889.23 µs 907.08 µs]
                        change: [-6.4918% -4.8119% -2.9210%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe
Benchmarking multiple_files_tarball/files/50
Benchmarking multiple_files_tarball/files/50: Warming up for 3.0000 s
Benchmarking multiple_files_tarball/files/50: Collecting 100 samples in estimated 5.1980 s (1600 iterations)
Benchmarking multiple_files_tarball/files/50: Analyzing
multiple_files_tarball/files/50
                        time:   [3.1980 ms 3.2272 ms 3.2605 ms]
                        change: [-8.2902% -5.7326% -3.3636%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) high mild
  3 (3.00%) high severe
Benchmarking multiple_files_tarball/files/100
Benchmarking multiple_files_tarball/files/100: Warming up for 3.0000 s
Benchmarking multiple_files_tarball/files/100: Collecting 100 samples in estimated 5.5579 s (900 iterations)
Benchmarking multiple_files_tarball/files/100: Analyzing
multiple_files_tarball/files/100
                        time:   [6.1341 ms 6.1913 ms 6.2539 ms]
                        change: [-12.355% -8.1693% -4.1873%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
  8 (8.00%) high mild
  3 (3.00%) high severe

     Running benches/test_detection_bench.rs (target/release/deps/test_detection_bench-a2922471602b47b6)
Gnuplot not found, using plotters backend
Benchmarking directory_walking/walk_dir/depth_2
Benchmarking directory_walking/walk_dir/depth_2: Warming up for 3.0000 s
Benchmarking directory_walking/walk_dir/depth_2: Collecting 100 samples in estimated 5.6465 s (20k iterations)
Benchmarking directory_walking/walk_dir/depth_2: Analyzing
directory_walking/walk_dir/depth_2
                        time:   [268.35 µs 271.54 µs 274.94 µs]
                        change: [+3.2187% +5.3005% +7.2662%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  2 (2.00%) high mild
  3 (3.00%) high severe
Benchmarking directory_walking/walk_dir/depth_3
Benchmarking directory_walking/walk_dir/depth_3: Warming up for 3.0000 s
Benchmarking directory_walking/walk_dir/depth_3: Collecting 100 samples in estimated 6.3153 s (10k iterations)
Benchmarking directory_walking/walk_dir/depth_3: Analyzing
directory_walking/walk_dir/depth_3
                        time:   [626.74 µs 635.82 µs 645.51 µs]
                        change: [-38.162% -31.915% -25.104%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe
Benchmarking directory_walking/walk_dir/depth_4
Benchmarking directory_walking/walk_dir/depth_4: Warming up for 3.0000 s

Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.0s, enable flat sampling, or reduce sample count to 50.
Benchmarking directory_walking/walk_dir/depth_4: Collecting 100 samples in estimated 6.9921 s (5050 iterations)
Benchmarking directory_walking/walk_dir/depth_4: Analyzing
directory_walking/walk_dir/depth_4
                        time:   [1.3722 ms 1.4017 ms 1.4365 ms]
                        change: [-76.934% -72.271% -65.990%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
  1 (1.00%) low mild
  5 (5.00%) high mild
  2 (2.00%) high severe

Benchmarking directory_walking_filtered/walk_dir_filtered/depth_2
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_2: Warming up for 3.0000 s
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_2: Collecting 100 samples in estimated 5.0355 s (359k iterations)
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_2: Analyzing
directory_walking_filtered/walk_dir_filtered/depth_2
                        time:   [13.620 µs 13.697 µs 13.780 µs]
Found 6 outliers among 100 measurements (6.00%)
  5 (5.00%) high mild
  1 (1.00%) high severe
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_3
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_3: Warming up for 3.0000 s
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_3: Collecting 100 samples in estimated 5.0175 s (364k iterations)
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_3: Analyzing
directory_walking_filtered/walk_dir_filtered/depth_3
                        time:   [13.743 µs 13.853 µs 13.975 µs]
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) high mild
  3 (3.00%) high severe
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_4
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_4: Warming up for 3.0000 s
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_4: Collecting 100 samples in estimated 5.0070 s (359k iterations)
Benchmarking directory_walking_filtered/walk_dir_filtered/depth_4: Analyzing
directory_walking_filtered/walk_dir_filtered/depth_4
                        time:   [13.597 µs 13.695 µs 13.801 µs]
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild

Benchmarking file_pattern_collection/collect_test_files
Benchmarking file_pattern_collection/collect_test_files: Warming up for 3.0000 s
Benchmarking file_pattern_collection/collect_test_files: Collecting 100 samples in estimated 5.3461 s (40k iterations)
Benchmarking file_pattern_collection/collect_test_files: Analyzing
file_pattern_collection/collect_test_files
                        time:   [130.00 µs 131.17 µs 132.45 µs]
                        change: [-66.827% -55.357% -41.444%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Benchmarking pattern_matching/javascript_patterns
Benchmarking pattern_matching/javascript_patterns: Warming up for 3.0000 s
Benchmarking pattern_matching/javascript_patterns: Collecting 100 samples in estimated 5.0000 s (654M iterations)
Benchmarking pattern_matching/javascript_patterns: Analyzing
pattern_matching/javascript_patterns
                        time:   [7.4950 ns 7.5322 ns 7.5804 ns]
                        change: [-2.1178% -1.6137% -1.0045%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
  1 (1.00%) low mild
  5 (5.00%) high mild
  4 (4.00%) high severe