Skip to main content

Module profile_autobatch

Module profile_autobatch 

Source
Expand description

Benching a model which serves several sessions at once: a saturating load, a paced one, and what a capacity search reports of either.

Split from super::profile because none of it works without threads, so the whole module is gated off on Wasm rather than every item in it.

Structs§

Churn
Sessions coming and going under a steady population: how long one is held before it leaves and another is admitted in its place.
PacedBench
What streams paced streams did against that clock: how long each turn took to run, and how late each one completed against the moment its input arrived. The second is what a real-time load is judged on – it holds the queueing a turn waited through as well as its own run.
Pacing
The wall clock a paced load runs against: what a turn’s input covers, and how much a turn may add over its arrival before it counts as late.
StreamsBench
What streams saturating streams did: how long they ran for, and how long every one of their turns took.