pub fn wgpu_active() -> boolExpand description
Default-on condition for the wgpu whole-token graph: the wgpu
backend on a DISCRETE adapter. NOT plain enabled() (macOS/Metal
must not pay a per-token layer scan for a graph its backend
refuses), and NOT integrated adapters: the graph’s ~300 barriered
dispatches per token are cheap on desktop immediate-mode GPUs but
tiled mobile GPUs (Adreno/Mali) drain the pipeline at every barrier
— field report: 0.2 tok/s on-graph vs 15 tok/s on the CPU. On
integrated adapters the per-op probe path arbitrates each op class
against the CPU instead; CMF_GPU_WGPU_GRAPH=1 still forces the
graph anywhere.
Is the wgpu backend active at all (any adapter)? Eligibility gate
for the whole-token graph — whether it actually RUNS is decided by
wgpu_graph_default (trusted on discrete) or the generation race.