Skip to main content

g4_batch_on

Function g4_batch_on 

Source
pub fn g4_batch_on() -> bool
Expand description

Gemma-4’s prompt on the batched wgpu graph (CMF_G4_BATCH=0 keeps the chunked host prefill it used before).