Expand description
Online concurrency admission: dynamically probe and scale connection counts based on measured marginal goodput.
When per-source rate limits and per-connection capacities are unknown, opening extra connections on an already saturated path adds request overhead without improving throughput.
This module implements incremental greedy admission: it probes connections one at a time, checks whether throughput increases by more than a minimum gain threshold, and settles at the optimal connection count upon diminishing returns.
Structs§
- Admission
- Per-source incremental admission controller.
- Delta
Estimator - Online estimate of the per-request setup cost
delta.
Enums§
- Admit
- Decision returned by the controller after each probe interval.